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SECTION I: INTRDDUCTION 

In May 1974, the Education Division of the Bureau of IndiaA Affairs embarked 

on a specific. project related to Indian control of schools* This particular 

project was designated by the Secretary of Interior as the Bureau* s prijnar>' 

"eciucation objective for FY 1975, The project's priority for implementation 

was enhanced when in November 1974 it was elevated to the status of ^ 

"Presidential Objectives." The Objective states: 

By the end of FY 1975, in at least one-fourth (50) of .the Bureau 
Schools, by official action of a tribal or Alaskan village govern- 
ment, a choice of the Management System will be made by those 
served by the schools. 

The School Management Options Project has been given further .si?)port and re- 
inforcement through the enactment of Law Bill S, 1017 \diich became Public Law 
93-638, the Indian Self-Determination and Educational Assistance Act . It is 
through this policy of Indian self-detenuinatipn that the School Management 
Options Project has been developed and implanented. 

Project development included the need for an outside Agency to monitor t^ 
Bureau's progress in inplementing the Objective, This evaluation project was 
intended to review the afJproaches and policies of the Presidential^ecretarial 
Objective Project and provide the information required for^plani)ifng and 
managing future activities of the project. 

Contracts were awarded to two Indian. Research and Evaluation firms to perform 

the evaluation. These firms were: 
«> 

(1) National Indian Training and Research Center', Tempe, Arizona 

(2) Underwood Research and Evaluation^ Tulsa, Oiclahoma, 

This report reflects progress on the project which/covers the period of June 
19^4 through December 1975, We believe that ead/ re^cier will find the report 
encouraging and will continue to follow the project^ progress* 
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FORWARD 



This report is based on a summary of field trips, ques- 
tionaire responses,, review of Area and Agency records, 
and extensive interviews with Bureau 6f Indian Affairs 
personnel (lERC, Area and Agency) tribal, council mem- 
bers, Indian leaders and affected parjents and patrons 
of BIA schools. Details juf much of Ihe information 
have been reported periodically' throtgh interim reports, 
.The attempt in this sununary is tq analyse and assess 
what has been happening with particular reference to 
whjr. From the data gathered and anal|[sed,'(recommenda- 
tions are made for the overall consid^ratioiv-.ojf- manage- 
ment. 
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INTRODUCTION 

The Bureau of Indian Affairs employs a systems approach to ntan- 

agement which is referred to as management by objectives (MBO) . 

A chief objective under this system, which was^accepted at the 

Secretarial and Presidential levels of Government and became 

known as the PresidentiaB^ecretarial Objectives (P/SO) , reads 

as follows : 

"By the end of FY 1975, in at least one- 
fourth (50^) of the Bureau schools, by offi- 
cial action of a Tribal or Alaskan Village 
Government, a choice of the Management Sys- 
tem will be made by those served by the^ 
school's." 

This objective has carried over to the FY 1976 with "some apparent 
modification in the offering. 

The participation of the National Indian Training and Research 
Center' (NITRcj in the evaluation of this program has been i^de 
under* a contract with the BIA involving P/SO activity in the AlV 
buquerque, Juneau, Navajo, Phoenix, Portland Ar.eas, and Central, 
Office. , , 

This report' is^ brganized to present a summary pf the findings and 
conclusions reached along with recoWmendations for consideration 
in overall Bureau strategy for pursuing the presentation of man- 
agement options to Indian tribes and groups. A brief overview of 
the BIA Area involvement follows. The Appendix provides a cri- 
tique of the slide-tapes .and copies of the various instruments 
developed for interview guides and data gathering. 
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SUMMARY AND CONCLUSIONS 

The conclusions reached and discussed here are interrelated and, 
in many instances, overlapping. They are discussed separately 
in the interest of clarity. 

1. There is almost, if not total acceptance^ or total inter- 
pretation that no decision means a decision . . 

This interpretation was made or accepted by most Federal employ,- 

ees (all field ejjj|)loyees) and appeared to be obvious to Indian 

informants. J6 Indian groups this type of decision (no incli-Ea- 

tion to act formally) seems to mean one pf-.two" things : (1) leave 

the school management • as . is. (under BIA.) or (2) wait and see. The 

overwhelming response to P/SO by tribes was to make no decision 

at all. The many factors discussed in this report provide the , 

rationale as to why no decisions were made, 

2. Decisions or "no decision" decisions are made in con- 

^ text or in relationship to an overriding factor or ' ' ' 
' factors that are, or may be peculiar, to the local 
group where a BIA school is^ located. 

Casa Blanca coni^nunity of the Gila River Reservation has just se- 
cured a new Federal school. Leaders .there showed no interest- 
whatsoever in discussing alternate management approaches. Some 
Papago communities are urgently seeking new facilities through 
the BIA. This overshadows any real interest in management op- 
tions. Arizona I-ndian leaders are fully aware of the seri-oiis 
funding problems plaguing the Indian related public schools. The 
fear of future funding in public schools has been mentioned sev- 
eral times; all .of which adds up to an overriding deterrant fac- 

9 



tor in even discussing the public school option. Xhe prevalent 
Arizona attitjide^ is to stay with BIA management. ^ Similarly, the 
funding problems ^^^RougT^^ school^are well known. 

In Alaska several major factors are affecting consideration of 
multiple management options; namely, (1) the long history and * 
precedence of public^ school take over; (2) Alaska legislation in 
the making which will further regionalize. Alaskan'areas for pub- 
lic school responsibility (BIA schools included in .regional at- 
• tehdaitce areas) ; (3) deadline on Alaskan Native,*Land Settlement 
which preempts time for other considerations; (4) the fact there 
is no provision for retrocession in the Alaska P/SO program; and 
(5) the fear of future .funding . 

Albuquerque Area made two contracts with two groups (Acoma and 
lAIA Board) to make needs assessments. While the grants were 
not directed toward a management' decision per se', the grants are. 
related to it and thus introduce new factors - compensation for 
-time, travel, etc. 

One school board (Gila Crossing) was preoccupied with getting 
rid of the principal which preempted time or energy that might 
have been given to consideration of management Options. 

The overwhelming factor in the Portland Area, that of getting 
concurrence from some 30 tribes, is a strong deterrant in secur- 
ing interest or activity relate^ to management options for the 
Chemawa School. Only the Warm Springs Indians gave consideration 



to an alternate approach to the present arrangement; namely^^ to • 



transfering instructional activities to the local public school. 

3. Internal problem?, squabbles, and opposing factions 
^and groups within tribes account for much P/SO dnac- 
♦ tivity. 

This is the story at Navajo. The confusion- resulting from 
charges and counter- charges between groups and individuals re- 
sulted in the moratori:um on all P/SO activity (December, 1974). 
Research of Navajo records and reports portray all the suspicion^ 
confusion-, misunderstanding and divergence of opinions between 
individuals and groups that characterize the overall findings in 



thi/s evaluation report. 

The Papago Superintendent reports the conflict is largely be- 
tween the elders who fear change and the young activists who are 
crusading for change without consideration of the needs and opin- 
ions of the majority* 



4. The passage of Public Law 93-638, and subsequent acti- 
vity is confusing the broader options offered under 
P/SO with the overall result of suspicion, gross mis- 
understanding and inactivity. 

The terra, self-determination , is being incredibly linked to both' 
the word and concept expressed by termination . This gross mis- 
""conception of the intent of self-determination is well documented 
in reports from all areas. The Chairman of the Arizona Inter- 
Tribal Council said the people, more than anything else, believed 
the BIA efforts in P/SO and self-determination activity were 



maintain the dormitories at Chemawa under BIA management while 
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linked to termination (meaning termination of trust land respon- 
sibility). The NASBA report on the Navajo pointedly portrays 
the gross misunderstanding that abounds. 

It is >an unfortunate coincidence that the P.S.O. , 
and the powerful expression of it in the Self- 
Determination Act should arrive from Washington ' 
^just as the Navajo Tribe is beginning to face 
the problems which contracting has already 
caused. Many Navajos fre beginning to feel that 
contracting, is bein>-iorced upon them, and the 
badly outnumbered supporters of contracting, (and 
take-over) are seeking outside encouragement from 
Washington. The encouragement is coming, — ijv-par- 
ticular from those explaining the Self -Determina- 
tion Act, and their presentations are furt^r 
agitating internal tribal conflicts. \ 

Pima reports state that many Indians f^el P/SO is an attempt of 
the BIA to "sell out". One Ute tribal councilman lost his re- 



election bid because he favored self -detesrmina^ion while his 
opponent interpreted this to mean ternvination (reported in The 
Ute Bulletin, December 23, 1975). * . 



5. The effort^of BIA personnel to implement the P/S object 

tive is being interpreted as pressure on the part of 
' • Indian groups to act. 
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Some Indians say we *'are being told what to do" and thaJLthe urn- 
plied pressure interferes with planning that was "going on'^ Em- 
ployees report they have used gimmicks to secure attendance at 
meetings. This apparently is being misinterpreted. 

6. The most frequent answer given by BIA personnel when 
asking, Why the problems, misunderstandings, etc.t-^-^ 
is "timing is off". 

* 

This seems to meau that the impact of the far reaching implica-. 
tioris in Self -Determination activity (with the many unanswered, 
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questions) thoroughly .preempts any early consideration of manage 
•* < . 

ment option-s im Education. One Indian' reported to havfe said,? 

"you told us, now come back* in five years for an answer/*' - 

♦» • ^ jf ^ , 

7.^ The lack of responses, to questionaires ^reflect the' wait 
~* and see attitude which characterizes the lack of any 

formal action on the v?st majoy.ty^of Indian communities 
^ or groups where MA, schools are Tocated. 

• NI.TRC forwarded^ §elf^ addressed (stamped) and easy-to-complete , 
questionaires to 70 Iijdian tribal councilg^n in the Phoenix Area 
an4 15 to Indian leaders in"the Alb^lq^erque Area. Only 5"re-" ' 
sponses .were received from Pho^fflx* Area and none from the- A-lbu- 
q[uerque Area. They seem to feel that even requests fbr informa- 
tion anA opinions as a. type of f)ressHre which creates apathy, 
suspicion and no response. Th.ree responses refer to the time ^ 
factor (much more time^needed) . / " 

*'It is not feasi^ble at "the present to absorb 
, the system wholly." - * <^ ' 

: ^*'No infpfmation^o tribal council. If and 

when infqrmatio^n ^is given, the decision-m'aking' 
. • .process will ble slow.* Change^i's always slow." 

'"n learning ^roce^s from the. top level to the / ' 
'^ass roots lev^l , and vi.ce^versa. To learn ^ 
th^ system at all levels- before, trying to edu- 
• ^ cate people for two to four^weeks to accept a 

system that have been in. existarice for many. 
yeaiiS." - - a /' 
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8. Neither of NITRC's precpnceived hypotheses^ can be sub- . 
stantiated from the data, collected. ' . 

NItRC proposed two hypotheses; namely, (1) that the P/S Objective 
'Should 'be implemented primarily through the Area Directors and 
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Agency Superintendents >fes the goal is primarily an administrative 
g.oal; and (2') that fear of loss of BIA jobs would be a. deterring , 
factor to effective promotion of the mart?Pgemenl 



t options . 

The fTrs'^t hypothesis could not be supported by testimony of the 



reservation superintendents. . They felt strongly that P/SO was 
primarily an education matter and should be h-andled by edutation 

a * 

personnel under the overall supervision of the agency superinten- 
, dents. Agency Superintendents at Pima and Papago are thoroughly 
knowledgeable of the P/s6 activity affectikg their Agencies, . 

The second hypothesis cannot be supported although Navajo reports 
allegatijpns that contracting, by the Trihe is aimed ^it putting BIA 
employees out of a job (letter of McDonald to Commissioner, Dec. 
13, 197*4); and rumors reported in school board minates. that the^ 
P/SO project was a threat to jobs. The fact that 5,^000 Navajos\ 
work for tlje BlA (approxinrately 1/2 in Education) lends some ere- 
dence to the hypothesis that BIA jobs^held by local Indians is a 
deterring factor in' their influence for change. At Hopij'^P/SO 
was given a low priority of (meeting agendas* This is understand- 
able at Hopi since their maj or - concern is the development of ^ a 
" high school under BIA auspice^s. 
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P/SO planning, enthusiasm and vigorous promotion/oj|^ 
the goal wanes as the execution of the program passes- 
from Central Office to Ar^ea and on to the Agency levels. 



At the Cental OfjFice - lERC level, there is excellent planning, 
a major effort in the development of training materials (slides, 
tapes), staff training", feed back processes and provision for 
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. timely reporting. AU- of this seems to lesseh as it passes 
through the Areas and even, more so at the Agency. While there 
are exceptions in effort the overall appears a valid conclusion. 

Some rationale as to whj^ would be the fact that area and agency 
coordinators have ^ multiplicity of other duties. P/SO seems to 
have been "tacked on" as an extra duty. At some agency levels 
. the coordinators are not only met with disinterest but occ?tional 
distrust and hostility. If nothihg else these -local attitudes . 
would dampen any enthusiasm. The recommendation might be made 
that area and agency management place a.higher priority of time . 
given by area and local coordinators to the dissemination of man- 
"agement option- info.rmation. ' • . . - ■ ' 

•10. There has been a gradual' shift in the use and empha- 

■ • •jsis of P/SO terminology to the. us,e of .such terms *as '■ 
a program of options to' Indian Communities. 

Th^is is found in most^area reporting \jtnd ?in. interviews wi.th BIA 

personnel." This appears to be good as- it helps to "eliminate the 

concept many Indians feel is impl'iea i? "the Government.- has an 

objective; we want you to act on it". The Alaskan brochure whidT 

we believe is very good., uses the available options approach. 



Terminology used plays another important part in- presentations 
to Indian grcyups. Individuals who reported they ha<i no knowledgg 
,of "P/Sd were familiar with' the options, especially contracting ^ 
aod the transfer to public . school jurisdiction. 

11.. Despite the • negative findings, there are some concom- 
atant benefits or "spin. off", to,. the. prog.ram.- 



Phoenix, Portland and Juneau Areas report the use of- the slide- 
.tapes and the request for their use by other organized Indian 
■groups for their general understanding. These auxiliary uses of 
the pr^-packaged materials may prove to be of more worth to the 
better organized ahd more experienced groups than to the reser- 
vation people for whom they were developed. 

12. There vere ,some real innovations made by two areas 
especially. 

Thfe Albuquerque Area*^ grants for needs surveys is a novel ap- 
proach. The- Juneau Area brochure which was given ^wide circula- 
tion, is both innovative and at the same time follows a widely 
u^ed and accepted method of disseminating information. 

V 

13. The reaction to the prepared slides' and tapes ranges * 
from very good to being "turned off". 

Despiste the vigorous efforts of BIA aVea and some agency, person- 
nel, 4fIsrRC estimates that most Indian leaders have not seen the 
slide-ta|i£ materials in the prepared ^training packet. Based on 
interview follow ups there was no interest shown to view them. 
Meaningful statistical data could not be found in the reports^ 
Groups, viewing one or two of t^ presentations in a single'^meet 
ing, generally indicated an interest to see more but somehow 
never §ot around to arranging for follow up presentations. 

The inability of NITRC to find a live Indian audience to evalu- 
ate reactions to the training , packet . is ojie of "the limitations 
of the study'. Notwithstanding, ' a critique of the training pack- 
^ et was made and is given in' the Appendix. 
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Why the wide .range d,f responses to the use made of slide:tapes? 
.The generally favorable reactions t/ the Navajo response which 
isaid, "tapes and film strips ... in their complexity actually 
confuse the questions > which are basic to various alternatives," 
may be 'interpreted in context with such factors as, (1) the de- 
gree of experience and- sophistication of the group; ,(2) the ex- 
tent that other local overriding fac-t9rs were their main focus 
of attention; and (3) the basic unreadiness oi the gro-up to take 
the first steps in cohesive planning. The No. 2 tape presenta- 
tion on needs Assessment introduces a new element that is differ- 
ent from the options, choices and a decision on management that 
is promoted through the other seven presentations. This might 
be the principal "confuser" to some audiences. 

r 

14. There appears to be an unfavorable element of control 
in any MBO objective that emanat.es from top adminis- 
. tratioh and. which seeks an -action by Indian people 
who had -no part" in .the- goaT development. 

It . seems to NITRC t}\at management by objictives is successful 

w>en top administration/has the control in a'.well integrated .pro- 

gram. However, when the element of "control" reaches Indian peo- 

pl^, it becomes a liability and creates resistance to any action. 

Since\l966 (Rough Rock),' Indian peo-ple have become increasingly' 
aware of the contract option :an<i a' much longer tl-ime tfl'the public 
school option. P/SO comes along and ■ is "plugged in" to an on- 
going program w'ith some new terminology and haste, if not pressure 
for action. A year following, P.L. 93-638 enters the "picture" ' 



w^ith fftr reaching implications to Indirfn people and their local 
governjiient. ; ' • ~ 

'The results found in the survey are generally apathy, disijiterest 
'confusion and misunderstanding of the motives behind P/SO, Only 
a few Indian grdups were far enough along in their thinking and 
local planning to malce a decision. Most of the people prefer to 
r wait and see, 

8 

15. Finally, factors inherent in the tribal situations and 
the program at this point in time account for the lack 
'of formal responses. 

While the interest and activity at the Area and agency levels 
varied in presenting the P/5 objective, the "fault" 'cannot be- 
laid to administrative management and direction or lack of it. 
We have no reason to believe that more detailed planning, ntore 
personnel involved, higher pr^tfrity on time given, better tools 
for presenting, the options, or more Y|igorous action, would hsve 
yielded any greater ^result's as measured by formal decisions 
reached. 
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RECOMMENDATIONS FOR THE CONSlofeRATION OF OVE R-Air BUREAU STRATEGY 

^— 

1- First and foremost all fiiture P/SO activity should be 
most caretully coordinated with all other BIA efforts 
in disseminating information related to P.L. 93-638. 

This is acute, especially as the latter may involve edAication and 
the schools. We cannot overstress the importance of the overrid- 
ing factor of limitation of funds mandated by P.L. 93-638 when 
schools are cohtracted for operation by tribes or tribal groups. 
This fund limitation should be thoroughly clarified to Indian 
groups, otherwise planning may proceed out of cont-ext with the 
most basic factor. Unless this is done, the result will be fur- 
ther confusion a^d disillusionment. 

2. Because P.L. 93-638 provides for contracting of par- 
tial and special programs, this fact should be 
stressed when the contract option in Education is' 
being considered. . 

' ^ 

It will cost more -for an Indian tribe or group €o take over the 
operation gf an on-going Federal school unless the BlA auxiliary 
costs for recruitment, purchasing, personnel, bookkeeping, audit- 
mg, supervision, etc. are computed generously in determining 
overall actual Federal costs for the tribal contract purposes. 
When the cost facts are known it may be much more feasible for 
the tribe or group to contract for meal service, transportation. 
Titled programs, dorm operations or some other partiaf^^or special 
program within the confines of the imposed fund limitation. In- 
surance aldne is a -large factor in any contract involving take- 
over of buildings and equipment.. 
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-s^3. The public school option should be kept viable and in 
^ no way "played down" in presenting P.L. 93-638 infor- 
mat ion . 

♦ 

The .pattern of public education in this country is through local 
public schools operated through the state government processes. 
Reservation public schools are being given increasing support by 
Indians. One Indian, during the course of this study, expressed ^ 
these thoughts: Why should we be different? Why can't w/^tak^^\ 
for granted the kinds of services provided other citizen^^? Why ' 
do we have to decide these things? 



/ 
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4V, All references to BIA objectives, even P/SO, should 
be played down, restated or eliminated entii^^^ly in . 



the disseminating of information on option^ in ^ 
school or program management. [' \^ 



An acceptable objective to Indian people would s^em to be toward 
greater effort in disseminating depth information that leads to 
greater understanding of the options available in school manage- 
ment. Based on Indian reactions uncovered in the survey, the 
latter should not denote an action on their part, even a' deci- 
sion. 



5. The BIA should change its reporting system to reflect 
"no formal decision" made as a (decision to remain as 
. is at this point in time. 

Once the BIAfhas given any local group adequate opportunity' to be 
rknowledgeable of th^^management options, this objective should be 
considered met. Any formal recognition of the decision ^ade 
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should be« requiTeS' only in. connection with any change in manage- 
ment the tribe may propose. A letter of intent from the local 
group involved would be far more pfactical to seek than a formal 
resolution from the tribe. • ; *- 

if 

AREA CONIMENTS 

i 

Albuquerque Area 

The Albuquerque Area operates ll'day schools and 3 boarding 
schools. The day schools serve the Pueblo communities where the 
schools are located. One boarding school (Albuquerque) princi- 
pally serves the Pqeblo and Navajo Ihdian groups within the Area 
jurisdiction. The other boarding schools CIAIA and SIPI) enroll 
students" -from all tribes natienwide., V 

The entir^ P/SO thrust Qf the Area has been directed at 4 schpo,ls 
(3 day and 1 boarding scKoo-lj: The*se are identified in the FY 
1975 summary. A present^tiqji was made to al,l Pueblo Governors a 
year ago and invitations extended to other school board members 
and leaders. No further requests /or. a presentation- of the man- 
agement options program has been received . Only the one Pueblty, 
(Acoma) has made a formal decision Cby Resolution). This deci-' 
,sion is^to remain under BIA manag'ement. Other Area, findings are 
discussed in, connection with the information given to support the. 



conclusions reached, 

\ 

\ 
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It is suggested that all schools be included ."on an equal foot- 
ing" in any future program for" providing management option in- 
formation. 

Juneau Area 

The Area operates 53 community day schools and two' boarding 
schools. The latter enroll students from all over the Area. 
The P/SO program focussed on 17 of. the day schools. Formal de- 
cisions have been reached in 4 of the communities, 3 choosing 
the public "school option and 1 for tribal-private management! 
However, information pertaining . to the options in school manage 
ment has been supplied to all communities where Federal schools 
are located. 

The extreme isolation factor creates an almost insurmountable 
problem for purchasing, supply and services for other than the 
Federal or public school option. Unless the extra-cost factor 
can be subsidized, complete take-over of schools in most vil- 
lages is totally unrealistic.. Since 1950 there has been a grad 
ual tran*sfer of BIA schools to public school jurisdiction (42 
schools). 

Navajo Area 

The Navajo Area operates 59 schools, 49 of which are boarding 
schools. Most of these seVve m^ore than one Chapter which multi 
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plies the problem of getting a uniform decision by the various 

» 

groups' involved with a single boarding school. 



The moratorium on presenting the P/SO program has not prevented 
both individuals and groups from requesting information. The 
greatest need at this time .would appear to be the development of 
some guidelines for the guidance of the local Area staff. How 
much information should be given to interested individuals and 
groups? And in what form? .Should the Area coordinator, on re- 
quest, appear at sch-ool board -or Chapter meetings for the pur- 
pose of disseminating infonffa?>k^n on the school management op- ' 
tions? These question^ should b\ answered. The whole 'question 
of the moratorium might be discussed with the new Area Director 
/and the Tribal Chairman. 

Portland Area 

The Area operates only the one non-reservation boarding school 
(Chemawa). The school enro lis ^students from over 30 "tribes in 
the Northwest. The problem of getting a decision is almost nil. 
Most tribal groups were disinterested in pursuing the matter. 
Chemawa School has received a planning grant for newyacilities. 
J'his virtually precludes reaching any, other option other than 
<?ontinued BIA management until this construction need is met. 
One Agency (Western Washington) forwarded 1 9 ^questionaires to 
Indian leaders and received only one response. Continued parti- 
cipation in the P/SO program would appear of no value to manage- 
ment. It is suggested that this Area be dropped from the program 

. . 
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Phoenix Area ' ^ 

The Phoenjx Area operates 14 community day schools, 3 reservation 
boarding schools and 4 off-reservation boarding schools. All the 
boarding schools have multi- tribal enrollments except Santa Rosa 
and Inter mountain. 

No schools in the Phoenix Area have made a formal decision with 
reference to the management options. All the deterring factors 
referred^ to iix the report summary affect the Phoenix Area schools 
one way or another. There would seem to be little value in pur-^ 
suing managemeitt options in the off-reservation boarding schools 
which serve many tribes. , ^ 

Central Office 

\ 

There seems to be a notion at the top levels , o'f BIA management 
that tribes are really interested in contjacting . We could find 
virtually no evidence of this in the tribal groups and individu- 
als contacted. ^ ^ ( 
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APPENDIX A 

TECHNICAL REVIEW OF TAPES 

1. Narrative 

2. Checklist Design 

3. - Checklist Summary 
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TECHNICAL REVIEW OF THE SEVEN TAPE/FILMSTRIPS ' 

« 

As a part of this contract, NITRC agreed to complete a 
technical' review of the seven tape/f ilmstrips. Drs. Bill and 
Carolyn Raymond, NITRC consultants with expertise in several 
areas including product development, reviewed .each tape/film- 
strip. Dr. Carolyn Raymond, currently Director of Staff Devel- 
opment of Mesa Public Schools, has spent the last ten years in 
the area of product development and staff. training. She spent 
four. years as a professional staff member of the -Southwest Re- 
gional Laboratory for Research andr'Development as a product de- 
veloper in the staff training divisioh.- Dr. Bill Raymond has 
also developed '"Several products;' Some of which directly relate 

to Indian Education. His most; recent experiences with Indian 
I " 

Education include serving as a technical advisor to an Injdian 
consultant firm in Albuquerque, New Mexico in the development 
of a series of curriculum imits for Indian students. Part of 
his current res'ponsibilities involve directing a federally • 
funded tutoring project, for approximately 900 Indian studeiits.' 
Prior to jppcoming involved in' private consulting wcfrk. Dr. Ray- 
mond w^s the Director for Evaluation at the Arizona Department 
-Of Education. . .* 

The evaluate rs upon receiving the assignment to evaluate 
the^ series designed a technical checklist to be utilized in re- 
viewing each.of the seven tape/f ilmstrips . Each tape/filmstrip 
was i;^\^:ewed considering ten major aspects of a developed pro- 
duct: 

JC . . 



product outcomes 

# assessmentNjaterials and procedures 

# reports of previous use and/or fieldtesting 

adequacy and consistency of materials and 

# procedures 

# versatility of materials and procelaures- 

use of soimd learnlj^^ theory in materials aAd 
^. propedures^ ^y^^^ ^ 

# content bias 

orientation and training materials and 
procedures 




' • # reporting materials and proc^^itir 
• • time and cost considerations 

The evaluators had also requested to 'be invited to actual 
sites where the' tape/films trips were being us^. It was th^ 
evaluatqrs Jiope that by actually observing participants view- ^ 
ixig the .tape/filmstrips that they could better judge^ the secies 
impact and effectiveness. Unfortunately, hy the^time the ev^T; 
uators v^^^, selected for this;,assignment, the tribes in the'im-^ 
mediate -vicinity had either viewed the ■ first one or two tape/ 
film^trips and had declined to. participate farther or had re- 
jected even seeing the ^irst of the series. For that* reas^on 
the evaluators were uncible to utilize this approach. 
> The material^^that follows is a technical review therefore 
based upon the instrument, designed by the* evaluator^*. The ac- 
tual instrument follows this narrative, with the judgements ' 
made regarding each tap6/ films trip. Immediately following is 
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an overarl general sumnary of the entire series. This approach 
was -selected because it became obvious after viewing the entire 
series that the original developers primarily used the same de- 
velopment techniques -in each individual tape/f ilmstrip. For 
that reason, the same strengths .and weaknesses from' a technical 
viewpoint tend to be conmion to all, 

AREA ONE : PRODUCT OUTCOMES 

The evaluator identified five major subcategories i relating 
to the broad area of product outcomes. These, five categories 
relate to the generally accepted educational practices regard- 
ing the preparation of product objectives as well as proper se- 
quencing, appropriativeness to intended audience, relevancy to 

1 

overall product goal, etc-, . - , 

Generally speaking, the product objectives were clearly 
and explicitly stated and- under normal circumstances their at- 
tainment would/ be relatively easy to assess.' /'While. it is true 
tJiat the product objectives 'are clearly stated, it is highly 
doubtful that the ehoice of words .presei^ted to- partici-pahts' 
would be €he same words tii at would normally be found in their 
everyday^ vbcabulary. , This is one of the -hallmarks of sophisti- 
cated product development, i.e., the vocabulary employed to re- 

- • * 

veal one's ob-jectives are virtulilly the same as that easily. un- 

derstoo'd'^by the intended' participant. It must be borne in mind- 

" . I 

that the overaia^^goai^l of the series is to deliver necessary in- 
formation for. participants to mak'e a decision regarding their 



choice of educational governance not to provide them fiacilita^ 
^ tion with new vocabulary words* v • * , ' ' ^ * 

In the e valuators' point of V.ieV, many of the "^n route** 
'product objectives did not relate to the overall goal of .the 
entire tape/filmstrip series. For example, in^ the first film- 
strip the following objective was presented to pa^tib4^antfe . 
•..Be able to explain what the Central 
Office of Indian Education programs has 
to do — develop a training pack- ' 
age to provide information on school 
mcoiagement and to explaia--tfe^ training 
program ^to each area office . 
One must question how knowing that a training program was 
to be devised has any relevancy to helping participants make a 
choice regarding educational governance. Many of the objec- 
tives in the series are just .hot -i^elevant for the desired out- 
com^..> In fact .much of the 'content must be questioned as to 
relevancy. - ^ .i* • ^ . 

AREA TWO; ^kSSESSMPJT MATERIALS MP PI^OCEDURES 

The secoftd 'Brqad, area has three subcategories .for critique 
related to assessment .material? and proceduresif.; included in the 
product. " After revieyjing materials presented to thia eva.luators 
there is no evidence which- vrowld tend tp indicate ^that an at- 
tempt was made to determine what knowledge;^-, if any, participant 
had regarding current governance of their Wdiicatiorfal i?xst^rnS/ 
■ etc. 'Furthermore, .no in$|truments e>cisted which could be ut;i- 




in' deterihining which of the many product ob^j'ectives \^ere 

■ • ' " . ' . • , ' ■ \ * " - - ' - . 

''ti<i% 'Being -^^ccoinpXishe^/by' p^arti-cipahts \ . ; 

"v;^' ;/Vr-^ ".z^^. --.v-.., = 

ing^asiiy^ ^tfCdmpli shej. -byH^^^^ whi-ch ones " 

they- are .^xperiencixig/^i^f Ictflty in achieving or wfiich'pnes - 
are-'not ieing .itt^t ^^t'all. O/iiy/when thj.s type if Vrocedjare is 
available .f of col^^ecting data^can proaijct developers J^ope' to be" 
abie.to inake product niodif icat'ioiisf leading to a rabr6 eff ebtive . 
product. 



' AREA THREE ; REPORTS OF PREVIOUS USE " " 

. \ The third broad area which jnost prpd^ict technicians -believe 
is necessary before the product, is implemented is alata regarding 
the effectiveness of the product prior to full scale use. Lack- 
ing from ^ the progreim was any data relating to previous product , 
V»saqe._ Skillful instructors/ trai^ could make use of such 
data as to- what .groups the product had been developed^ its ef-^ 
fectiveness, ete. The lack of this ty^ of data leads the eval- 
uator to question whether the original .draft documents were, pro- 
perly pilot and field tested prior to the full scale implementa- 
tion. 

AREA FOUR ; MATERIALS ANp" PROCEDURES — ADEQUACY AND CONSI^TEliTCY 
" The next three areas are a critique of the materials and 
^procedures. This first area deals with eleven cr^iteria pertain- 
ing to the adequacy and' consistency of the product. . For the" 

\ ■ ■ ■ • • • 
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most part., "the product does a rfe<a_,sonal^le job in matching the ac- 
' ti^ijfies: direjptl^^^ the objectives within each program. Wheth- 
^K^-^'^^P'^.^^P-f '^'^^'^'^^^^^s are the mo^t appropriate is another 
que'SrtipjTt:^ ' ' those activities selected do appear to be 

'difeetiy* related to intended outcomes. 

/V.r^'^fo^tunately, in. the subcategory that rates whether or not 
the* instructional materials are likely to produce adequate par-'^ 
ticipant interest and enthusiasm, the evaluators would have to 
judge most of the materials as seriously deficient. Some hard 
evidence is available in that it j.s the evaluator's understand- 
ing that most groups after viewing the first tape/filmstrips, 
refusedSyto partiiitLpate in the further viewing^ of the remaining 
series.^. ^ 

There ate a few pluses for the prbduct in this area. , They 
are 'convenient and easy to use. They are relatively low in pro-- 
ducti^on costs. , ' 

Byt as mentioned earlier, the evaluator question's whether 
SCTne of ^t^he things' which were taught really needed to be taught. 
Those things which were selected to^be included in the instruc- 
tional parts of the program were done in a very skimpy fashion. 
The product would be vastly improved by eliminating half of -the 
pr^oduct objectives and providing more information on those re- 
tained. In some cases, the transition between -the information 
being presented for one objective does flow smoothly to infor- 
mation being presented for the next objective. However, in many 
situations this is not th'e case. 



AREA FIVE ; MATERIALS. AND PROCEDURES — - VERSATILITY 

i " ^" ^ » " 

This area had six subcategories dealing with the' versatili- 
ty of the product. The evaluators would judge this entire area 
to be weak. The series, fails to provide a variety of approaches, 
■ to, deliver the intended information to the participants. 

AREA__SIX: MATERIALS AND PROCEDUBES -- SOUND LEARNING THEORY 

Regarding the incorporation of sound learning theory into • 
the overall 'product, .the evaluator identified ' ten major sub- 
categories that could be examined to "determine whether or not 
the product met minimum standards. 

. One subcategory relates, to whether or not the product is 
organized in such a manner so thaV parti cip^ts have early know- 
ledge of the purpose of the presentation frevealing^bjectives) 
and why it is important for them to obtain the objectives. In 
this area most of the filmstrips did present the participants 
the objectives as well as a rationale as to why it was desirable 
for the objectives to be achieved. Unfortunately, selection of 
vocabulairy was either too technical or too abstract to compre- 
hend for the average person not familiar with the concepts. ' 
•t ■ Other concerns in this area center around the lack of ef- 
'' ficient examples of the concepts that the tape/f ilmstrips were 
. attempting to teach or those that were provided did not clearly" 
'illustrate principles or. concepts' being described. One widely 
. , accepted effective teaching methodogy -is actively involving par-, 
ticipants. That is to say, the product should be so designed 
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that opportunities exist for the utilization of activities that, 
require participants to become actively involved rather than 
passively sit through a series of pres,ei\tations. In this re- 
gard, the tape/filmstrips were quite deficient. It is also gen- 
erally accepted t3iat instructional/training methods should be 
mixed in order to help combat^ participant boredom/ etc** All of 
the tape/filmstrips employ the same instructiprial approach. 

Effective instructional/training p'roducts need to provide 
participants with ample opportunities to practice the behavior 
called for in the objectives. Usually the more nearly the 
practice behavior simulates the desired real life behavior the 
mo^e effective the. product becomes. 

The evaluators determined that the tape/filmstrips did pro- 
vide adequate practice. However due to the fact that often the 
wrong objectives were chosen as far as the evaluators critique/ 
one mast- question whether time should be spent in practicing 
,^he behaviors in these- programs. But from a teffchnical point of 
view the product did meet the criteria in this area. 

One other broad category which' the evaluators in their eyal 
uation of the product actually divided into three parts but for 
general discussion purposes will be combined deals with the fact 
that the most effective instructional products usually contain 
pi;ocedures for giving feedback to participants. Unquestionably, 
participamts need to have knowledge as to whether or not their 
progress is satisfactory. Normally it is best to provide this 
'feedback almost immediately after a segment of instruction/train 
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ing has' been provided. Effectiye feedback procedures provide 
the participant with positive reinforcement when his responses j 
have been correct and it also p!rovides him the opportunity to 
immediately correct any incorrect responses before they become 
deeply ingrained. Generally speaking the ^ tapes/fi^s trips did 
provide participants with the opportunity to obtain feedback 
to the practice exercises. 

0 

AREA SEVEN ; CONTENT BIAS 

This area deals with any biases that might be'-^present in 
the content of the product. Specific items checked would be 
whether or not racial, tribal, or religious biases had inadver- 
te-ntly found their way into the product. An evaluation in this 
area wouJ.d also determine whether or not the produ^ was free 
of sex role stereotyping. Other factors to be considered would 
be whether or not the illustrations used covered a wide variety " 
of tribal groups rather than limiting 'all 'of their /.llustrations 
'to the larger more obvious tribes. In this particular area the 
evaluators fqund the product to be adequate. While a non-Indian 
(evaluators) does not have difficulty identifying the obvious 
biases that might inadvertently be in a 'product, it must, be re- 
membered that the more subtlfe^ biases may go unnoticed. I . 

AREA EIGHT ; ' ORIENTATION AND TRAINI NG MATERIALS AND PROCEDURES 

In the evaluation of a training product many times the 
things that are not present are- as important to evaluate as those 
present. The evaluators were not given any materials which ac- 
companied the product which provided instructions to the trainer 
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as to how he was tjo implement the ^product. These materials 
might have existed.. However, the evaluators are of the opinion 
that training piateriafs for the trainer had not been developed, 
A whole garnet of considerations fall under this area of consid- 
eration. It is imperative and often the eventual downfall of a 
product if orientation ^nd training* material and procedures do 
not accompany the product. Such guidelines should include: 

^* clear identif ixration as to the responsibilities 

of the trainerX and other staff . '( ' 1 

^ \ 
comprehensive lifting of all materials needed 
to effectively present the series ♦ 

description of pretraining activities and re- 

• sponsibilxties ^ 

specification of scheduling procedures including 

• the amount of time to be allocated for effective 
presentations 

. " listing of participant objectives so that the 

f trainer has no room for doubt as to what he is 
.expected to accomplish 

d^1::kiled -description of all stral^egies the train- 
er will use to accompsi;ny the product 

completely §elf contained material so a trainer 
need not go elsewhere for other resources 

training materials which promote^ a positive atti- 
tude on the part of the trainer .^^J^ 

• identification of all preparation needs 

^ listing of all materials, equipment needed for 
delivery of the product and directions for use 

^ description of necessary facility requirements 
such as tables, space, etc. 

• scripts for ail narrationv discussion or verbali- 
' zation which the trainer is to deliver 

• Scunple agendas for training^ sessions 

3-5 



J Some of the inadequacies that the evaluators noted in the 
tape/filmstrips could have been overcome with an effective 'train 
ing module for^^the tr^inet as well as a participant training pro 
gram with structured discussion, Intetaction, pfroblem solving 
activities,^^^tc. , interspersed before, after, and between the 
various tape/filmstrips. . 

AREA NINE ; REPORTING MATERIALS AND PROCEDURES 

. Again as in Area 8, the ' evaluators were not given any ma- 
terials relating to how the product had fared in previous situa- 
tions' with, varying audiences, in order that the trainer -could 
■maite the necessary adjustments to his particular group of parti-' 
ci^ants. Moreover, it is to the advantage of' the , product , recog- 
nizing there is no perfect product, for concerns or problems 
Which are apt to occur to be described along with ways the train- 
er can handle such problems., - ^ 

AREA TEN ; TIME AND COST CONSIDERATIONS 

In the last broad area under installation and delivery of 

♦ 

the product, two question's are asked — are the time require- 
ments for installing and conducting the product acceptable and 
can the training be adapted to yarious situations as well as 
are the costs of . installing the product to local situations ac- 
ceptable? The evaluators determined that the approach used, due 
to financial limitations of the technical review, would restrict 
judging the product on these questions. Therefore no judgement 
is made in this area. 
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TECHIIICAL CHECKLIST FOR REVIBIIflG 
mSTRUCTIOriAL. PRODUCTS* 



IDENTIFICAT.IQN 

^itie : introduction' 



Sequence Number One 
Assessor RAYMOND 



^Instructional Length of Product \ 
Date Assessed 



Summary R^ting^ 



ui 
I- 
< 

>-c 

uio 
X 







UJOi 






HZ 






<H 








< 












a 






Ui 




< 


Q 


< 




< 


UL 





PART I 



□ □□□ 

D □ □ .□ 

o_a...Qn 

D O 0 . 0. 



^OUTCOMES 
a 



Are expected outcomes expressed in terms of ob- 
servable proficiencies participants will acquire 
as a' result of instruction? 



b. Are^ the outcomes, as a whole, worthwhile for r 
participants? 

c. Do the objectives relate to the purpose of the 
training module? 

d. Are the objectives sequenced properly? 

e. Are the. objectives at appropri>ate participant 
level,? 

2. ASSESSMENT MATERIALS AND PROCEDURES 

a. Are placement .measures and procedures included 
• that clearly indicate the point at which a parti- 
cipant should begin instruction based on his current 
Skill level? • , 

b. Are measures included that periodically identify • 
specific oatcomes on which the learner may* be ex- 
periencing difficulty? . 

c» Are endrof-program measures included that assess 
attainment of all outcomes? 



Adapted from H ) Considerations in Selecting Instructional Products, Appendix 
— SWRLT (2)A^essment Instrument, A Classification Scheme for Career 

. Education Resource Materials, HEW Office of Education, 1975. (3) Assessment 
Tnol Pnr Dpterminina "Good- Staff Development Training Module, C. Raymond, 11^/^ 



Tool For Determi^ning TGood- Staf$ pevelopment Training 
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3. REPORTS OF PREVIOUS USE 

«• .Are data presented to indicate that outcomes* 
have been consistently attained by, previous 
userB? 
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b. Are data indicating trainer and participant - 
** attitudes toward the product repdrted' in 

quantitive terms and not, just in the form of 
* . a £ew "endorsements*^? 

c. Are data presented to show that the product 
has been used 'successfully in a wide range 
of situations? 

\ d. Do the data indicate that it is likely the 
•\ , ^ product will be effective in local instructional 
sittxation? 

* ' *~ • 

4. MATERIALS AND PROCEDURES — ADEQUACY AND CONSISTENCY 



a 



b. 



c. 



Are materials and activities keyed directly to 
the expected instructional outcomes? 

Are the instructional materials* likely to pro- 
note adequate participant interest and enthu-- 
«iasm? 

Are materials or suggestions included for -separate 
supplementary activities for those participants 
riot reaching acceptable achievement levels on any 
outcome? 

Are materials and procedures convenient and easy 
to use? ^ . 

To what extent is the nature and scope of the 
naterial content adequate to reach the objectives? 



£. 18 the organization and preserttation of the con- 
tent consistent with objectives and outcomes? 

Does the, material cover every sirfjskill that 
logically contributes to the, objective? Are 
there any gaps in the material, i.e.> have any 
«»«ential items of information not been included 
in the instructional sequence? 

h. Are any parts of the material ambiguous, too ' 
"lean", or in some other way deficient? 
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□ □□□ 

□ □□ □ 
□□ □ □ 

□□ 6 □ 



□ □ □ □ 

□ □ □□ 

□ □ □ □ 

□ d □□ 

□•□ □□ 

□ □ □ □ 

□ □ □ □ 



i. Does the material contain any .unnecessary 
information (i.e., how much of the material 
must be processed by the participant in order 
to make the desired response?) 

j.. Does the product sequence the activities 

materials according to the difficulty of the ' V 
task? ' * . . 

k.^ Are the transitions smooth between various 
• ' ' activiti»es of the product. 

5, MATERIALS AND PROCEDURES — VERSATILITY 

a* To what extent are various optional instructional 

strategies provided? (Instructional strategies j 
are methods of teaching such as simulation, group 
instruction, individual programs, etc*) 

b. To what .extent is a range of activities provided 
that involves participants in different kinds 'of 
learning experiences? 

c. To what extent are alternative activities for 
participants with special needs provided? 

d. To what extent is individual as well as group 
instruction provided? 

Q. Is the material content consistent with growth 
- and development characteristics (physical, emo- 
tional, social, and iij^ilectual) of target groups? 

f» Do those materials express identical content in 
acre than one audipvigual medium? 

6i MATERIALS AND P,RT)CEDURES — * SOUND LEARNING THEORY 

a*. Does the.jnodule have an appropriate introduction 
or advaaceS organizer to display to the partici- 
pants the desired terminal behavior? {^Revealing 
Objectives), purpose ?(Perceived Purpose), 

b» Does the module provide several illustrations of 
illl xjeneral concepts being taught? 

c. Do the exemplars clearly illustrate the principles 
or concepts being described? • ^ 
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<!• Do the activities provide for active participant 
involvement? 

e. Are there carefully sequenced exercises designed 
to cover- each aspedt of the objectives being 
covered? * . 

£. ' Is the delivery bf the information varied^? {is 
there lecture, problem solving, mediation — VTR, 
slide*-tape, reading, discovery) • 

h. .Is there practice immediately following a short 
segment of in§tructionx 

i. Does the' module contain continuous feedback 
procedures so that ithe participant will get regular 
reports on his progress? ^ 

j. Is the feedback following each exercise clear and 
complete (e.g., does the feedback provide an 
explanation of why a particula;^ participant res- 
ponse is inappropriate)? 

Is the feedback immediately following a short 
segment of instruction? 

h CONTENT BIAS 

Material contains role-models to which a 
member of a tribal group can relate. 

If the material contains visuals, the characters 
depicted represent a variety of .various tribal 
groups » 

Material includes characters with Qames indicative 
of a variety of tribal groups. 

d. Material is free of racial bias., 

e. Material is free of tribal bias. 

f. Material is (fee of religious bias. 

g. Material is free of sex role stereotyping. 
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PART II • ^ • 

installation/delivery of product 
3." 'orientation and training materials and procedures 

a* Do the materials clearly identify and define 
the responsibilities^ of all personnel involved 
in product, usfe? 

b» -Do the materials include convenient and efficient 
resources (e;g,r pre-progi;am workshops , self-study' 
materials) to orient all personnel to their 
individual responsibilities? . » 

c. Are clear guidelines for instructional sch^dluling^ 
provided r i.e., start-up dates, instructional v ' 
time allotments, pacing guidelines? 



ev 
f. 



Are trainers provided with clear expectations 
of product performance? 

To what extent are user directions provided? 

To what extent^ds background infoxjmatibn provided 
to the user so that the person will not have to go 
beyond the material to seek help? 

To what extent are user strategies specified?^ 

*, • 
To what extent are directions for additional 
training provided? . 



i." To what extent are training materials identified * 
and provided? 

j. DDes the module promote positive instructor 

attitudes? . • 

k. DDes the module indicate estimated instructional 
t^e? . ^ _ \ 

1. Does the module identify instructor' preparation 
and, time needed? ^ . 

m« Ija-^ere a listing of all necessary materials 
and equipment for delivery of the module? - as 
^ well as directions for use -^'detailed plans for 
mateirials tt>at may need to Jse constructed? 

n. Daes the module contain (or give clear directions 
on how ,to locate) the required equipment and 
materials.? 









Has 








UJ 


Ul 




< — 










< 


< 




OC/) 








Ui — 


>a 








OCUJ 


HI 




< 


.UIO 


a 


< 




X 


< 




— o 



• 0 □ on 

□ □ □□ . 

a n □ □ 

□ □ □ □ 

□ □ □□ 

□ □ □□ 
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.Program Nxunber One ' 



If ythere a description of necessary facility 
rmuirements if called for? (tad)le arrangements, 
*space, etc.) 

Is there a timed sequence to follow? 

Is there a script fpr all narration, discussion 
or verbalization done by the instructor? 




r. Are there sample agendas for each session? 

9i REPORTING MATERIALS AND PROCEDURES 

^ a.' Do the materials include means to generate and. 

transmit frequent Reports on participant achieve- 
ment and progress to appropriate audiences? 

b. ED the materials include resources for the in^ 
provement of problems related to instriictionar- 
coBqpletion? 

10, TIME aId cost considerations ' ' 



a« Are the time requirements for installing the 
product and conducting training acceptable to 
various situations? 

b» Are the costs of installing and using the product, 
acceptable to local situation? 
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TECfflllCAL CHEOCLIST FOR REVIEWING INSTRUCTIONAL PRODUCTS 



TAPE TAPE TAPE TAPE TAPE TAPE 
#1 #2 #3 #4 #5 #6 



OOTCOMES 



«« Are wcpected outcotncs expressed in VA VA VA VA VA VA 
tens of observable proficiencies 
participants will acquire as a re- 
sult of instruction? 

b. Are the outcomes, as a whole, IM P IM ' P A A 
worthi#hile for participants? 

c. Do the objectives relate to the IM P P F A A 
purpose of the training module?* ' ^ ^ 

d. Are the objeqtives sequenced , • IM VA A A A VA 
properlf? 

t. Are the objectives at appropriate IM ' IM IM IM F P 
participant level? 



M 



ASSESSMENT MATERIALS AND PROCEDURES 

a. Are placement measures and proce- M 
dares included that clearly indi- 
cate the point at which a partici- ♦ . / 
pant should begin instruction basjsd 

on his current skill level? 

b. Are taeasures included that perlodi* ^P P A P A VA 
^ ""cally identify specific outcomes on 

which the learner may be experien- 
clnf difficulty? 

c. Are end-of-prtygran* measures in- M M M It M M 
' eluded that assess attainment of 

all outcoaesf 

, lEPORTS OF PREVIOUS USE • ^ ^ - 

a. Are datli. presented .to indicate M M M M- ^ M M 

that outcomes have beHn consistent- 
ly attained by previous users? 

^A'Are data indicating trainer and j)arsii.^M M M M M 

ticipant attitudes toward t 
/ duct reported in quantitivi 
« ' and <not just In the form of a few 

**eivdorsements'*? 



enjjs 
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TATE TAPE TAPE TAPE TAPE TAPE TAPE 
#1 #2 #a #4 n 16 #7 



3. (con'O 



e* Ar« datft pijtsentsd to show that the * h m K M M M H 

product has bee^'uBed successfully i 
in a vide range of si'cuaciotm? ' 

d. Do the data indicate that it is M M M M M M H 

likely the product vill be ef fee-* / 
tivt in local inscructionid situa- - 
tion? 



4. MAIBltlALS AND PROCEDURES — ADEQUACT 
AND COHSISTENCT 

a. Are uterials and activities keyed VA VA A A VA v ^VA- VA 
diractly to the expected ins true- . " ' * » 

tional outeomefl? . ^ 

b* Are the ins tnuf tional oaterials IM IM IK IH F F F 

likely to promote adequate partici- ' 
pant interest and enthusiasm? ^ « . 

e. Are aaterials or suggestions ±vr H> M M M M M H 

eluded for separate supplementary 

activities for those participants f ^ ' 

not reaching acceptable achievement 
Icvela on any outcome? . - 

d. iCre aaterials and procedures con- VA VA VA VA VA VA VA 
▼eniant and easy to use? 

e. To vfaat extent is the nature and IM F IM ^ F A A A 
scope of the material content ade- 

* quate to reach the objectives? * ' 

f« Is the organization and presentation A A A A A VA VA 
of the content consistent with ob«- > 
J actives and outcomes? 

g* Does the material cover every sub- a A . F A A VA VA 
skill that logically contlributas to 
the. objective? Are there any gaps 
• in the material, i.e. » hav^ any es- . 
sential ,1 terns of information not » 
been included ib the instructional 
sequence? 

h. Are any parts of the material ambi- IK IM IH IM F A VA 
itious» too **lean*', or in some other 
triy deficient? 




TAPE TAPE TAP.E TAPE' TAPE TAPE TAPE 
#1 #2 #3 n #5 #6 Jl_ 



(050? t) 



1, Does the iuftcriAl--<»atarflx a unnec^ m TA IM IM F ^VA . VA 
MMry information (i«e«» hov zouch of « . 

tha Mtcrlai must be p'rocessed by 
* tha participant in order to maka the 
daaired rcsponac?) ' 

Doas tha product sequence the acti- IM P A A ' VA -VA . VA 
vltlea Mterials according to the 
difficulty of the ttsk? 

k« Ara tha transitions smooth between IM A A A VA VA VA 
various activities of th^ product? 

5. MATERIALS AND PROCEDURES — VERSATILITY 

a^ To what extent are various optional IM IM -IM IM IM IM IM 
instructional strategies .provided? 

(Inatructidaal strategics ar^ path- " , 

oda of teaching suchgjas simulation, 
group instruction, Ifldlvldual pro- 
graaa, etc.) 

^ ' ' ^ ' <. 

To what extent is a range of activi- IM IM IM IM IM .IM IM 
tiaa provided that involves particl7 

pants in different kinds of leatning . ' 

experiences? 

To what extent are tltemative acti- IM IM IH IM IM IM ' IM 
. vitles for participants with special 
needs provided? , 

' d. To what extent is individual as well IM IM IM IM IM IM ^ IM 
as group instruction provided?* 

a* ^a the material content consistent IM IM IM IM IM IM^IM 
with growth and development ,charac- ^ * 

terlstlcs (physical, emotional, so- 
cial, and intellectual) of target . ^ 
groups? 

f . Do those materials express identical IM IM M M M M M 
content In more than one audiovisual • 
•ad'iuDi? ' * * , 

6. MATERIALS AND PRjOCEDORES — SOUND LEARNING ^ ' *% 

THEORY ^ 

a* Does the module have tn appropriate P PIHJA A AVA 
itttroduction or advanced organizer 

to display to the* participants the ' 
daaired terminal bthav;lor? (Reveal- 
ing Objectives) , and purpose? (Per- 
ceived Purpose)* 



3 ■ , • i 



1 




TAPE TAPE TAPE TAPE TAPE TAPE TAPE 
<1 #2 #3 #4 #5 #6 #7 



6. (con*t) 



b. Dots th%«odttle provide several il- IM IM IM F A VA 
lustrations of all general concepts 
being taught? 



€• Do the exeaflars clearly lllxistrate IM IM IM 
the principles or concepts' being 
described? 



d. Do the activities provide for ac- , JH IM IM IM IM IM IM 
tlve participant Involvement? 

a. Are there carefully sequenced* excr- P IM IM F A A M 
dses designed to cover each aspect 
of the objectlvu being covered? 

f • Is the delivery of the Information IM M M M M H H 
varied? (Is there lecture » problem 
•olving, mediation — VTR, slide- tape, 

readltig, discovery). - ^ 

g. is there practice inoedlately fol- VA A A F A 'A • M 
loving a short segment of Instruc- 

^ tlon? 

h. Does* the* fflbdule contain continuous va VA VA A VA VA ' M 
feedback procedures so that the par- 
ticipant vlll get regular reports 

on his progress? 

1. Is the feedback follovlng each exer- VA VA VA VA VA VA H 
else clear and complete (e.g., does ^ 
the feedback provide an explanation ' * 
of why a particular participant^ re- 

•ponae Is inappropriate}? * , 

r ' ' ' • 

J. Is the feedback iBimedlately follow- - VA VA VA VA VA VA M. 
ing a abort segment of Instrwtlon? 



?• COHTDrr BIAS ^ ^ 

a. Material contains role-inodela to VA VA VA VA VA VA VA 
vhich -a nember of a tribal gtoup can 

relate* 

J • 

b. If the material contains visuals, VA VA VA VA VA VA VA 
the characters depicted represent a* 

variety of various tribal groups. . ' . ' 

« ' _^ * 

c. Material Includes characters with VA VA' VA VA VA VA VA 
naata indicative of a. variety of ' 

tribal troupt.. 
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TAPE TAPE TAPE TAPE TAPE TAPE TAPE 





11 


#2 


#3 


#4 


-#S 


#6 


#7 


(cott'fe) 
















d. MtUrial is free of racial bias* 


VA 


,^VA 


VA 


VA 


VA 


VA 


VA 


Materiil is free of tribal bias* 


VA 


VA 


" VA 


VA 


. VA 


VA 


VA 


f* Haterial free of religious bias* 


VA 


. VA 


VA 


WA 


VA 


VA 


VA 


S* 'Material is free of sex role 
•tereotyping. 


VA 


•VA 

m 


VA 


VA 


VA 


' VA 


VA- 


OXIKHTATIOtl AMD TRAINING MATERIALS 
AND PROCEDURES 






• 










e* Do the Mterlals clearly identify 
ead define the responsibilities of 


M 


M 


M 


M 


M 


M 


H 



ell pereomxel involved in product 
ttset 

^ b. Dd^.tlie uterials include convenient « M M M M * M 

|. mi^ efficient resources (e,g», pre- 

C ' profrae workshops, self-study 
^ --.^ aatirials) to orient all personnel 
to -their individual responsibflf- 
tieer 'f 

: ' \ 

c. Are deer guidelines for iiistruc- M M M M ' M M 



tlonel scheduling provided, ^l^^^^ 
start-up dates, instructional time 
ellotsents, pacing guidelines? ^ .« . 

d. Are trainers provided vith clear M M «M* ' M M . M M 
expectations of product performance^ 

e. To what extent are user directions M ^ M M M M M M 
provided? 

f. To what extent Is background infor- M M M M M M 
Mtlon provided to the user so that 

the person vlll not have to go be* 
yond the material to seek help? 

f. To vbat extent are user strategies M M M M M M H> 
specified? * ^ ' » 

h. To vfaat extent are directions for M M * M M M M H 

^ditlonaX training provided? 

1. To vhat extent are training materials M^ ^ M M M M M M 
identified and provided? 

• 47 • • 
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6. (con't) 

Dots the aodule proaote positive M M M 

instructor attitudes? 

k. Does the module indicate estimated M M 
instructionsl time? 

!• Does the aodule identify instructor M M M 
prspsrstio'n snd time needed? 



TAPE TAPE TAPE TAPE TAPE TAPE TAPE 
#1 #2 #3 #4 #5 '#6 #7 
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'B. Is timers a listing of ell necessary M m"m M M M K 
aattri^ and equipment for delivery 
of the-sodule? - as veil as direc- 
tions for use - detiiled plans 
saterials that may need to be con- 
structed? 

.n. Does the «odule contain (or give M M- M *M *M M 

clear dlrectiQns on how to locate) 
^-^^ the required equipment and materials? 

^ • . 

o. Is there a description of necessary M H M ^ N M H 
facility requirements if called for? 
(table arraogesents, space, etc.), 

p. Is there a tiaed sequence to follow? M M N' M^M M M 

q. Is there a script for all narration,* M M M * M M M M 
discussion or verbalization done by 
the instructor? 

X. Are there sample agendas for esch H ' ~M * M M M M M 

session? ^ * 



9. KBPORTING HATERIALS AND PROCEDUKES 

a* Do the aatetials ipclude means to MM 
%^.^t*o«rate and ttansiolt frequent re- 

porta on participant achievement 

and progress to appropriate audi-^ 

encas? 

^. Do^the aateriats include resources H M 
for the ii^roveaent of problems re- 
lated' to instructional completion^ 



TAPE TAPE TAPE TAPE TAPE TAPE TAPE 
#1 #2 #3 #4 #5 #6 #7 

10. TIME AKD COST. CONSIDEKATIONS 

Art tb« tlM requirements .for in- 7 ? ? ? ? ? 

stelling the product mild conduct- 
las training accepteble to various 
situations? 

b.^Art the costs of instalUng and ? ? ? ? . ? ? ?s 

using the product acceptable to 

local situation? ' ' • 
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APPENDIX B 



COPIES OF INSTRUMENTS DEVELOPED 



'J 
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PRESIDENTIAL SECRETARIAL OBJECTIVES FOR MANAGEMENT OF INDIAN EDUCATION 



PRELIMINARY INFORMATION-GATHgRINjG QUESTIONAIRE 

Date ; 

AREA OFFICE: . 



>ART- I ; 

Name of >roject Manager j 



Agencies Involved :^ 



Telephone No, 



Names of Responsible Agency Personnel 
(Include Telephone No's.) 



PART 11 ^ (Please enclose) 



2. 

4- 

5. 
6« 



Area Plan for Implementation 
Monthly Progress Reports ^ 
JReports of Presentations ' 
Audience Response Forms (if -any) 
Any other documents you deem important 

Schedules of future presentations (Please" include dates, places 
and times.) • ■ • 



ENCLOSURE (2) 
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INTERVIEW QUESTIONAIRE ' 

Area office: 



Agency Office 



Tribal Group: 

Individuals Hamet ■ 



1. What Kipd of School does your tribe have? 
* ' ' ' 

2. Have you heard about contract schools? 

3. DO you know about the different- kinds of schools you can haJ^, other 
than contract or BIA schdols? ^ 

..M. ■ Did .you hear about the Presidential/Secltetarial Objective for the 
■anageaent of Education for Indian People? 

5, Did you attend a presentation on this P/SO, if so, how many? 

6. . Wh*t is your tinderstanding of P/SO? ^ ^ 

•' 7. • •"do you feel it ca-n help or hurt Indian Pebple-? 
' 8. Mhen you heard the presentation, did you have any questions about it? 
f : llhat do you think could make this better for your People? 

* 

10. Hhat did you like best Jjbout this presentation? 
U. What didn^t you liice about the presentation? 
*' 12. would- you go to another presentation? ^ •- 

13 IS there a statement you would like tp make about P/SO or about the 
; ;;,seStLion? If so use the back of thxs paper. ^ _ 

' 1£ this question is answered," Yes, then ask the following questions.' 



- PBB8IDEMTIAL/SBCRETARIAL OBJECTIVE (M.B.O.) 



GUIDELINES FOR AREA/AGENCY OFI^ICES 



Area Of f ice strategy and implement Rlan. 
(Obtain copies and monthly progreiss'^'reports) 

Identify : 

a. Personnel making presentations 

b. Attitude of Area Manager and Staff 

c. Knovledge of Pres/Sec. Objective 

d. ' Individual's personal opinion of P/S Objective 

Groups that have had presentations maBe* 

f . Names of individuals who have attended presentations 

Make written^suntmary of visitation. Attach all pertenint 
materials. Include personal observation. m 




^PASSr imi'luse extra paper, if necessary)- 
• . • 

1. Hatoe of Tribal Group that will have presentation/s; 



Kama of indi^rldual to contact: 

Telephone No. 



Bow mAy contact be m£tde: 



Datt presentation planned . ^Locat^or 

pertinent Information: (as to why and how to be made, 

bi-lingual. and etc . } 



2. Name of Tribal Group that will have pres^tation/s : 

» 

— — ^ : ~ ~ ^ ' 

Name of individual to contact: 



Bow may contact be made: 

^ r 



Telephone No. 



Date presentation planned 

Pertinent Information: (as to why and how to be made 

bi-lingual' and etc.) 
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PART yil._ (use extra paper, if necessary) 
!• Haae* of Txibal Group that has -^had presentation/s: 



Haae of Individual to contact: 



How ma/ contact be made? ' 



Telephone No. 



Date presentation made: 
Action taken: 



Number Attend. 



Are' additional presentations plcmned?_ 




Tribal Group that has had presentation/s; 



of Individual to contact: 



tfow -may contact be made? -^r. fit%/" 



Telephone No. 



Date presentation" made^^ 
Action t2Ucen: . 



Number Attend. 



Arji additional presentations planned? 



3. Name of Tribal -Group that ^ has had presentation/s: * 



^ Name of t]ldivi(iual to. contact: 



Bov may contact be made? ' 
/ 



Telephone No.^ 



ERIC 



Dat^ presentation made: 
Action taken: 



Nun^^er Attend. 



Are additional presentaiiions planned?^ 



INTERVIE 



AGENCY OFFICE 
W QUESTIONAIRE 



♦ Area Office:^ 
• ■ Agency Office:^ 
Agency Persons ^ame ; . 



1. How do you feel about P/SO? , / ' 

• * * ^ 

2. , What recpnanendations jdo you have to improve implementing 

the over-all program? 

3. Does the ajadunt of Training and Orientation you received, aid 
' ^ or hinder you? 

4; If you could start this program over, do you feel^ result^ 
would be differeift?' 

5. What do you feeT the final results-^will be, as things are now? 

6. Please state your personal opir^ion as to why Tribal groups' 
seem hesitant? . ^ . 



7. Are there points of P/SO, that you feel should be clarified to 
you?^ (i.e. ,retrosession, PL93-638 and strategies toward 
unspecified goals) , • 

Do you feel that P/SO is a positive move toward, true Indian 
Self-Deteimination? 

9. What are the .most common negative feelings that you have 
h(?ard toward P/SO? \ • . ^ 

10. Do you feel adequate/ in being able to handle these obj.ectioiiS? 
^ 11 • What hav^ been positive ir^arks or feelings toward P/SO? 

o : ' " 56 • 
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NATIONAL INDIAN TRAINING AND RESEARCH CENTER 

SUITE 204 » 2121 SOUTH MILL AVENUE ~ TEMPE, ARIZONA 85282 

C . PHONE (6021 967 9484 

July 15, 1975 



Dear Tribal Leader: 



The National Indian Training and Research Center is under con- 
tract with the Bureau of Indian Affairs to make an evaluation 
of the Presidential/Secretarial Objective Program. Our purpose 
m wra.~ting is to request your assistance in developing a status 
report of yoiir Tribe with reference to the selection of future 
management options -affecting your BIA school or schools, 
f • ■ 

The goal of the Bureau's P/SO program is to get tribes to se- 
lect a management option for the future operation of the remain- 
ing BIA schools. Most of you may have seen some of the. slide- 
tape presentations where the management options are explained. 
The options are: 

(1) to transfer the. BIA school to a public school opera-' - 
tion % . , 

(2) to contract with the BIA for the operation of the 
V school 

(3) to remain as is -* a BIA school 

(4) a comlDination of the above options 

The P/S objective is to get tribes to select an option formally; 
that ^s, by tribal resolution. 

We need your help to assist us in the development of a present 
status report . To save your time we are enclosing an easy-to- 
complete questionaire along witji a self-addressed, ready-tb-r 
mail envelope for your convenience. 

Your assistance is appreciated very much. 



Sincerely Yours, 

Francis McKinley 
Executive Director 



FM/sm 
O „nclosures 



STATUS REPORT - SCHOOL MANAGEMENT OPT50NS (for Tribal , Leaders) • 

1. -Were the -people on your reservation generally f aiuiiia'r ,witti\ ; 
the BIA policy of changing th^ management of BIA schools when-^. 
requested by the tribes even before the P/S object;'ivi$ wast^ ari-'^ 
nounced? .YES NO ; ^i \ , K/i 

2. Are the people now generally familiar with the ppt^^pfe; faVij./t*^,p \ 
tribe to Contract fou the operation of a BIA schpolK^i -i^yDSV'/^^^^^ 

3. Are the people generally familiar with other ppfi^^pns.j j^^tsV,:^^ 
management of BIA schools? YES NO .\ - \tj'x<^i'^^^ 

• 4. Have you. seen any of the BIA slide-tape preserx?r^^'^''^«°'' '^^^^^^^ 
describe the^ school management opti 

5. Has there been any follow-up raeei ^ ..v^*, .^^^ 

school management options as a resuit o^/l^f ll^'^i^^e^^^ 
tations madron your reservation? '^ifBS.^^^^ ' 

6. Has your tribe reached a decision ahpalj^vfc^ ink'hagement 
of your remaining BIA .school or 4s6ii^^isi?*fi^S vIVES NO • 



7. If no formal decision (by tribal ^^{^.lutidl^) lhas been reached, 
what is your opinion as to why.no.'^l^^^iibbjhas been made at 
this time? . '^j^:^ ':^r 



8w What do you suggest that would he, a good way to get the message 
to the Indian people that they haVe a -choice as to who should 
' rxin the present BIA school ' (or schools) iri titfeir community? 





9. What is . your opinion aa- to which of the below management op- 
tions is favored by the people in your district; 6r tribe?, 

.,,.'•.**.• 

a. Tribal contract ^:fpr.. the cp^ta^tion of the BIA school 
b". Transfer the "BI A. school to a public school 

c. Make no change; remain a BIA school 

or 

d. The people prefer not to be rushed into making decisions 
before they are ready. 

^ 10. Please feel free to make any other coimnents (on back of page) 
that would help us to make a good evaluation of the BIA*'s 

P/S Objective Program. ^ ^ • ,58. 

O ^ ■* . 

E^^iank you vary much. National Indian Training and Research Center ^ 
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» ^ [| NATIONAL INDIAN TRAINING AND RESEARCH CENTEl 

SUITE 2W • 212t,SOUTH MILL AVENUE • TEMPE. ARIZONA 85232 

PHONE (6021 967 9484 

November, 1975 



The BIA is promoting a program of options with reference to the 
future i^anagement of BIA schools i The Na^onal Indian Training 
and Research Center has contr'acted to make an evaluation of this 
program. The program itself resulted from a Presidential and 
Secretarial Objective and. is popularly referred to as the P/SO 
program. 

Our purpose^ in this brief interview^is to find out how you feel 
this program is progressing with reference to the communities on 
ydur reservation where BIA schools are located. 

You do not need to sign your name. We need only 
Your reservation: 



Your home community: 



BIA school (or schools) : 



Please give us your comments on the" following questions: 

1. To your knowledge has the matter of options oertaining to the 
future management of BIA schools been presented to the people 
where these schools are located? f 

YES NO UNKNOWN 

If your answer is .YES, how was the program of options pre- 
sented to the people? 
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2. Are* you familiar with the. slide- tape presentations that arc 
being used as one means of presenting the ptpgram? 

YES - NO If YES/ do you have any comment about them? 



= 3, - Do you feel the people in the home community where a BIA school 
is located are interested in pursuing P/SO in order to select 
a management option? , 

' \ YES NO UNKNOWN 

4. '* Do you feel they know enough about it to make a management 

option . decision? 1 

\ YES NO ^ UNKNO^TN 

5. What is your opinion on \^hy many Tribes are hesitant in making 
\ a decision about the management options available to them? 



What would.be a good way to get the message' to the Indian peo- 
ple that they have a choice as to who should run the present 
BIA school (or schools) in their community? 



7. What is your opinion as to which of the below management op- 
tions is favored by the people in your district or tribe? 

a. Tribe /Contract for the operation of the BIA school 

b. Trems/xer the BIA school to a public school 
c» Make no change; remain a BIA school 

- d. The pebple prefer not to be rushed into making decisions 
' before they are read;^/ 

Please feel free to' make any other comments (on back of pages) 
that would help us tq make a good evaluation of the BIA's P/S Ob- 
jective Progjram, 

*• 

Thank you very much for your cooperation. 

. 60 

ERIC national INDIAN TRAINING AND RESEARCH CENTER 




NATIONAL INDIAN TRAINING AND RESEARCH CENTER 



SUITE 204 



21 21 SOUTH MILL AV^INUE 



TEMPE. ARIZONA 8528? 



PHON&(602) 967-9484 



Tp the Members and Alternates of the Phoenix 
Inter-Tribal School Board (and any visiting guests) 



You have seen a slide-tape presentation which provides infor- 
mation that is basic to a tribal decision about selecting a 
management option for the future operation of the remaining. 
BIA schools. 

Perhaps all of you are aware of the BIA's Presidential/Secre - 
tarial Objective Program (referred to as the P/SO program) . 
It?^is an important tool of management especially as it relates 
to the goals and philosophy of Indian self-determination. 

Most of you may not know that the National Indian Training and 
Research .Center .is under contract with the Bureau of Indian 
Affairs to make an evaluation of the P/SO program. 

We need your help in assembling vital information that will 
assist the BIA in its effort to get the message to Indian 
people that they have a choice as to who should run the BIA 
schools . 

There are separate easy-to-complete questionaires • Please giv< 
us your opinion on each of the questions asked. You do not 
need to sign your name . ' ^ . ' 

We would be happy to have any visiting tribal members at this 
meeting complete -the questionaires also. 

Thank you very much. 



Sincerely Yours, 

Franc i's McKinley 
Executive Director 
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Most of you are /'wearing.Jwo hats**; that is> you are not oi 
^ne'Eptb^er of the Phoenix Area Inter-Tribal School Hoard, but yo^ may 
li\re in a Gommunity where there is a BIA school. Hence, you may 
havfe a -broader interest in th\3 P/SO program. 



The pur|)ose of this questionaire i^ to get your opinion 



on 



1. The slide-tape preseintations you have seen; 

2. P/SO as it relates, to the Phoenix Area School Board; and 

3. P/SO as it may^Telate to your horhe community. 



The Slide-Tape Presentations you have seen ,^ 

1. In your opinion how would you rate the effectiveness of the 
filmstrips which you have seen? 

^ • ' * Jif^ 

I I Superior ^ 
/ / Above Average 
/ ^ / Average 
/ / Medidcre 

/ / Bottom of the Barrel . 

*» 

2. HoK clear was the message that was presented in the filmstrips? 

/ / Superior * 

/ / Above Average 

/ / Average 

/ / Mediocre 

/ / Bottom of the. Barrel 





was the overall pace of tne^ilmstrips 



/ / Pace \vas just right 

/ / Pace was far too fast 

/ / Pace wa's a little too fast 

/ / Pace was far too slow 

7 1 Pace was a little too slow 



4, How well did the' f ilmstr ips hold your interest^ ^ 



/ / You were highly interested all the^4,nie 

/ / You were interested most of the time 
/ / You 'had high interest at the start but lost 
interest 

/ / You were only interested for brief periods 

of time / 

I I You have very little interest at^^^l * 



5. Judging against 'ather ilk information diss^miination programs- 
that you have seen, how .Would you rate tlie filmstrips? 

/ / Superior \ - _ ^ 

/ / Above Average ' 

, ' ' . / / Average * 

/ ^ / Mediocre . . * *• . 

/ / Bottom of the Barrel 



6, If you were r-esponsible for explaining the various management 
options to' tribal members would you use the filmstrips? 

/ / Yes .without a doubt- ^ ^ 

I I More tlTan likely ^ 

I I Only parts of each filmstrip . 

/ / Probably not ' • * 

/ / No... would not iise' 



7.- How appropriate do you feel that content and vocabulary of 

the filmstrips are for the majority of your tribal members? 

/ / Very appropriate 

/ / About right 

/ / A little too difficult 

/ / Quite difficult . 

/ / Extremely. difficult 



8. Were there any portions of the filmstrips that seem especially 
inappropriate or distasteful to you? 

I~l Yes ' rZJ No 
If your answer is yes would you plgase comment 



9. What do you think were the two most important points of each 
filmstrip that you saw? 

r 

(1) 



(2) 



10* Any other additional comments that you would like to make 
about' the filmstrips? (use back of page) 
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'P/SO as it relates to the Phoenix Area Intcr-Tn'bal School Board 



Ir Now that you have some information on the management- options . 
for running BIA sc^ols, do you feel that some type* of . act iom 
^is in order now? YES . NO ■ 



2. If YES, what 'should- the Board do? 



ERIC 



at- 



3. If NO, what are the problems or ''stumbling blocks'* to making a 
decision? 



4, Contracting by the Board to run the Phoenix Area Boarding 
Schools would appear to be one feasible option. 

a. Would you favor contracting? YES NO DO NOT KNOW YET 

b. If YES, when would you- favor such a step? 



^' c. If NO, what would be your reasons? 



d. If you DO NOT KNQIV YET, what should the Bureau do that 
would be helpful tp the Board in making a decision? 
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PASO as it iriay relate to your him <\ x'omnin i nncM r i_l2£ 

1.. Do you feel tKe people in the' Hoi)>e community where a BIA 

school a located, are interested in pursuing, P/SO in orddf to 
select a management option? ' YES NO UNKNOWN 
. * .J * 

2. Do you feel they .-know enough about it to make a management 
option decision? YES- NO UNKNOWN 

f> . . * 

3. Why are the Phoenix Area Tribes hesitant in making a decision 
about the management options available to them? 

' >— _ 



4. What would be a good way to get the message to the Indian 
people that they have a choice as to who shoiil.d run the pre- 
sent BIA school (or schools) in their community? 



5, What is your opini'^n as to which of the below management op- 
tions is favored by the people in your district or tribe? 

a. Tribe contract for the operation of the BIA school 

b. Transfer the BIA school to a public school 

c. Make no change; remain a BIA school 

or 

d. The people prefer not to be rushed into making decisions 
before, .they are teady. 



Pleas? feel free to make any other comments (tn back of pages) 
that would help us to make a good evaluation of the BIA's P/S 
Objective Program. 

' Check who you are: BOARD MEMBER, ALTERNATE BD. MEMBER, GUEST 

Thank you very much for your cooperation. 



NATIONAL INDIAN TRAINING AND RESEARCH CENTER 

Er!c ... 6o 
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EVAl^UATION OF THE IMPLEMENTATION OF 
THE PRESIDENTIAL/SECRETARIAL OBJECTIVE 



^ Statement of the Problem • 
■« • * 

• ^ ** . . . 

The Bureau of Indian Affairs, ^along .with other -agencies of the Federal ' ^ 

Government; is employing a systems approach administrative strategy known 

generally as Management By .Objectives (MBO) • The strategy calls for 

prioritization of objectives, the highest befing accorde4 a Presidential 

and/or 'secretarial level rating. The Presidential/Secretarial Objective 

for Indian education for FY 1975* concerns selections of a management system 

for their schools,' by Indian ^d native Alaskan people currently being 

served by these federal schools. The selection made is to be an informed 

decision, which is reached after careful consideration of available options. 

., The responsibility to^package and present objective information upon which 

such decisions must be^ based, was placed upon the BIA Education Office 

The present st;udy attempts to evaluate the effectiveness with which BIA 

' ^ ■ • • •• 

^ has disseminated information regarding scKool management by Indian peoples. 
Specifically, the study has assessed the adequacy of the Bureau's strategies 
and plans for attainment o^f the Presidential/Secretarial Objective for Indian 
education, \ ' . * 

■ \ 

" Soiirces of ^Information 

\ 

The following report is based utoon information from four major sources: 

• \ ' . * 

" 1. Site visits to Indian sc}|ool^ in the Aberdeen, Muscogee, Anadarko^, and 

Eastern Are^s, with interviewsXconducted with the target audiences.* 



♦Target audiences ^re: Members of tribal governments, tribal members, BIA 
school board members, parents oi BIA Students, and staff members of BIA 
schools.' " \ 



2. Survej^. instxruments completed by targ^t^ audiences. 

3 . Review ||||^ the research te'am of the BIA-prepafed training* packet whieh 
addresses the Presidential/Secretarial Objective, „^ ^ 

4. ^ Review of the reports cuid monitoring prooedures- of the four Area Office 

» * » 

regarding the Presidential/Secretarial Objective. ^ 



Design ai^ Proceaures * ^ 

^ ^ ' m 

>, * *■ ' 

The work as specified in the contract was performed in three stages. The 

•first, or planning' stage, w^s between May 8, 1975^ and May 25, 1975. The 

IP 

first stage of the study Entailed a visitation to the Indian Education 
Re.sources Center office, 'and a' gathering together of the apprl^p^iate 
Research emd Evaluation Reports;' such as Resecirch and Evaluation Reports 
29.00-29.04. . , - . , . ^ ^ , 

^ • ■■ - ' ' ' . ' . . 

In addition, the program training jiackage, along with various monitoring 

. . - ' ■ ' //; V , . 

reports, were obtained by the study ±eam. Meetings were arranged with BIA 

Central Officer Project personnel in Washington, D. C, , and in the four 

participating Area Offices (Aberdeen, Anadcirko, Eastern/ -and Muskogee). 

♦ • 

Survey instrtunentation n^ded for the study was developed during this ^ 
phase. In conpunction with' the Indian Education Resources Center, 
priorities with respect to target Simulations should be members of tribal 
goveaniments , advisoiry school board m^ebers, and parents of BIA school 
Students ♦ Although thi^se aforementioned groups were accorded^ highest 
l^riority/ several o,ther concerned groups* Wera, also, surveyed during the • 



^valuation ^effort. Darta from th^se various groups will be presented later 
ip the report. * i'^- , , 



/ 



St'age 2, the data gathering st€qe , spanned from May 25, 1975;. through 
December 15-, 197 5, During this ^^ase, research teams conducted site visits 
' in all four Areas concerned. Structured interviews were conducted with BIA 
.Area and Agendy personnel, tribal councils, school board members, and teacher 
and administr.ators in the BIA schools themselves. All concerned parties w.ere 
given ample opportunity, to e.xpress views', make recommendations, and to pro- 
vi4e any commentary for possible inclusion in the final evaluation report. 
In ad(^ition to the site visits themselves, survey instrumentation *which.- had 
been developed in stage 1, was sent out to several target populations,^ 

Stage 3 involved analysis of the interview and survey data, and preparation 
of the. final report. Stag4 3 was'from December 15, 1975v to the date of 
issuance of the final report, ^ . • 

. Site Visits 

Aberdeen: The study team conducted on-site Visits to the schools in the 
Aberdeeiii Area from June 15, 1975, through August 8, 1975, During that 
period of time, the Area Office and fourteen schools in the Aberdeen Area 
were visited. Each site visit to a particular $chool is describe|\elow. 

Crow Creek School, Crow Creek Reservation 

The study team visits Crow Creek: School and interviewed the Agency 
Superintendent, and the Principal, It was learned that the Crow Creek 

High School has already been contracted and that this present arrangement 

/ ^- ' \ ^ 

is felt to be satisfactory. The school board had become well-acquainte.d' 

with the Presidential/Secretarial Objecti/^e , and had considered contracti.ng^ 
for the elementary school, but has taken n6 formal action- 



Lower Brul.e School, Lower Bt'ule Reservation 

On August 4, the research tecim visited the Lower Brule School,, and conductei 
an in-^epth interview with the Agency Superintendent. The Superintendent 
described the funding of the Lower Brule School as consisting of Public 
School^ District ctnd BIA funds, along with Impact funds* The school at 
that time had approximately eight Indian teachers. 

In jSi meeting of parents called by the Superintendent, there was no interest 
expressed by them in the Presidential/Secretarial Objective. Therefore, 
no further meetings were held. Formal presentations were given to school 
board members and to school pFincipals. Reaqtion to the training packet 
prepared by the BIA was mostly ^vorable. The one criticar comment made 
was that the packet was entirely too long. However , the overall reaction 
-was that the packet provided a great deal of valid information. Reaction 
on the part of education ^taff members who received presentations were 



^Cmi] 



lilarly positive. No formal preserftations were given to the tribal 

council members. ' . ^ l" 

/ ♦ 
Another interview was conducted with the principal of the elementary 

school, who, having Been principal only since June, had not had an oppor- 
tunity te see the training^ packet , Finally?||pin interview with the school 
counselor ,, was conducted. The counselor indicated that' sHe had been given ^ 
a presentation of the trainij^g packet by ^Aberdeen Area personnel. Her 
reaction to the material ^was positive. In short, it appears that consider- 
able effort to apprise target populations of the Presidential/Secretarial 
Objective 'was .made, and that the reaction 'to. the BIA-prepared training 
packet was,^or the most part, positive. ' *• * • . % 
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^^imm- Eagle Butte School/ Cheyenne River Reservation 

bij Tuesday/ August ^5 # a visit was made to the Eagle Butte School District 
and an intert/xay cotiducted with the Acting Education Program Administrator, 
^the Acting Mucati^cfilyr^ Prograin Administrator indicated that presentations of' 
the^'^aining packej^j^t^ad been .given to the cooperative school board consisting 

'I i'/ ' 

(. of three tribal co^cjils , three school boards / and one high school senior. 



*** The reaction of th|^;OT9peratiye school board to the presentation, was mixed. 

; — . jif i • ' ' 

General feeling w3s»',that the presentation provided valid- information, but 
that the packet w^^jr^jtoo redundant and elementary. When asked about grass ^ 
roots awareness of fthe Presidential/Secretarial Objective, the Acting 
Education ProgJ:^ |,jvdininistfator felt that there 'was probably very little. 
Amongst th^e acquainted with the Objective/ there seemed to be little 

" * fear tha^:' the Objective implied '^termination, " 

/' 

Swif^'^Bird Day School/ Cheyenne River Reservation 

/// . ^ ^ . . ' 

A^'^in^epth interview was conducted by the research team with a member of 

,:/itne school staff.- - She indicated that presentations regarding management 

^ ' ' . ' ' 

/.0^^- options were made to parents and all staff members of the school/ along 
with the school board members and Title.^ advisory board members. The 



presentation was made by the Education Program Administrator/ and an Agency 
Education Specialist, and was f^Vt to be highly successful; that is, triose 
attending the meeting felJi that they understood well the management options 
available to them* In addition/ there was no particular concern about 
terthination on the part of the parents or the education staff, 

^Vhite Hor^e School Cheyenne River Reservation 

A site visit was made to the White Horse School/ and an interview conducted 
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with the principal, who had been school principal for a period of 20 year^ , 
Presentations of the training packet had been provided to the cooper.^tiv':.- 
school board which serves for White Horse and Pr9mise bay Schools, and a 
number of parents. Presentation was made by" the Education Program 
Administrator. Reaction to the presentation was generally positive on the 
part of school board members, school staff, and some parents. The principal 
f6lt thai there was probcibly very little awareness of the management options' 
on the part of most parents, and also on the part of tribal representatives/ 
There seemed tb be some fear of termination in response to the presentation 
made. The training packet was generally felt to be valid and adequate. 

Crazy Horse^School , Pine Ridge Reservation 

On Wed^sday, August 6, a site visit v^as made to Crazy Horse ^p^iool / and 

Z'nterview conducted with the Acting Principal. The Actylng Principal 
essed a feeling that most of the concerned populations on the Pi|ie ridy- 

Reservation felt that if one school contracted^ that all schools must contra 

* 

In"" addiction to an interview with the Acting Principal, interviews were 
conducted with other members of the school staff. Other interviews were 
conduct;ed with three school board members. There appea'red to be minimal 
• awareness x>f the Presidential/Secretarial Objective cind the ffianagement 
options available. - ^- 

Little*^ Wound (Kyle) School, Pine Ridge R^servatign 

An interview was conducted on August 6, with ^the principal of Little Wound 
School. He :i^ndicated that several presentations had been given to schooi ^ 
board members and to education staff, but that there was typically poor 
attendance. In addition, the' principal indicated that the school board 



Jha^ parsed "contracting resolutions" several times in the recent past, but 
to.no avail. The feeling on the part of the board was that BIA was not 
seriously interested in contracting. . - * * 

American Horse Day School/ Pine Ridge Reservation 

On August 6, a site visit was made by the research team to the American . 
^ Horse Day School. Interviews were conducted at the school with the Acting 
Principal, and with a Title I aide. In addition, a telephone interview was 
vendue te<?S^with the chairman of the school board. The chairman indicated 
that all school board members had been given a presentation, as had a 
number of the parents. As a function of these presentations, he estimated 
that perhaps 85% of' the community was already aware of the Presidential/ 

c 

Secretarial Objective and had some understanding of the management options 
available. The reaction to the presentations created some feelings of 
fear of termination/ and revealed a fair amount' of satisfaction with the 
present school arrangement. ^ . _ 

Porcupine School-, Pine Rjdge Reservation 

In the absence of the principal , one of. the staff members served in his 
behalf. In addition to interviewing the Acting Principal, two teachers 
were also interviewed. A telephone interview was conducted with a school 
board member. The school board member indicated that board" members had 
made repeated requests to the Area Office for presentations, but that, the 
/ requests had not yet been honored. It was felt that there was probably 
little widespread information regarding management options available under 
the Presidential/Secretarial Objective, All those interviewed shared these 
views. ' » ^„ 



Manderson School / Pine Ridge Reservation 

A «ite visit was made by the research team to Manderspn School. An inter- 
view was held with the teacher-supervisor and Acting Principal. A memiJer 
of the teaching staff was also interviewed. It was learned that* present^ 
tions had been given, and that there* was" s^n awareaess oh the part of*' board 
members. Parents were felt to be well-informed about the management optioa-^ 
available and frequently engaged in discussions of them. -If^^as not certain 
whether the training packet was utilized in the presentations. 

Pine Ridge 

An extensive interview 'was conducted with the Education Program Administrat3x 
at P.ine Ridge. He indicated that there had been extensive presentation of 
the management options, utilizing the training packets. Presentations were 
tade« by principals, with some help fro^ the Education Program Administrator. 
Presentations were made to board members and tribal council members. React ion 
*to the presentations was generally positive. While the presentations were 
felt to be too prolonged, it was also felt that they quite adequately 
explained management options ^ available . The Education Program Administrat" r 
made a plea ^pr tihe availability of mpre of the training packets, since 
they had been utilized so 'successfully . He further indicated that even 
more presentations would, have been made had it riot been for recent difficulty 
on the Piae Ridge Reservation, which caused, people to be r^^ctant to attenri 
evening meetings. ? - 

Oglala Community School, Pine Ridge Reservation 

A site visit was made to the Oglala Community School, and an interview 
conducted with, the high school principal. He indicated that the presidonfc 



of the school board had made several presentations to explain contra.ctincr , 
and that roost, but not all, board members had seen the training packet, m 
addition, the school newspaper "War Cry" had carefully covered the manage- 
ment .optipns available. There was mixed sentiment on the parfa^board 
members, with some wishing to contract, and others wishing to remain "as is.** 
It was felt that -the coverage in the schdol paper had resulted in consider- 
able awareness on the^ part of townspeople regarding the management options 
available. 

IjOneman Day School, Pine pidge Reservation . . . 

The research team made a site \;isit to Loneman Day School and, interviewed 
the principal. He indicated 'that two filmfe had been shown' to school board 
^nembers at PTA meetings, and that the response was essentially negative. 
Some board members made threats to withdraw children if the school did 
contract. The community appears to be very divided regarding the possi- 
bilities of contracting. It appears that factions have developed on the 
part of board members, with several board members living in housing pro3ectb 
away from the communities they are supposed to represent. In addition, 
there is some controversy as to who are the "real" representatives, with • 
the' present existence of two school boards. It was felt that a vote taken 
now by tribal members would defeat 'contract arrangements. 

.'I ■> , ' 

Cherry Creek School, Cheyenne River Reservation. 

'At the Cherry Creek School, the research team spoke with the janitor, the 

V. 

only person on the premises. He indicated that there was cohcern over 
opening the school in September. At that time, he felt quite uncertain 
about the likelihood of its opening. 

% 
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Muskogee ; On June 12, 1975, the research team made a visit to the Musko^j 
Area Office, There they met with and interviewed the Assistant Area Cir'r.t 
for Education. He indicated that the tribal chairmen were notified that, 
if they wanted a presentation on the Presidential/Secretarial Obj'^c^tive, • 
the Area Office would be glad to send the training packet to them. He 
reported that only one tribal council member at that time, made a reque^l 
for such information. However, there is no indication that that person 
pursued the request by making further contact or inquiry with the Area 
"^^Office. In addition/ the inter-tribal council was informed that it could 
make a presentation regarding the Presidential/Secretarial Objective wa-. 
not placed on any agenda. 

He expressed the View that, to fami'liarize tribal council members with tlie 
various options available (through presentation of the training packet) , 
would appear to infringe upon the independent decision-making of these 
tribes, A similar position was 'taken by an Education Specialist f9rmerly 
'^^ Project Director at Muskogee , when visite^ b^ the research team in 
Washington, D. C» 

Sequoyah. School ^ 

On June 12, 1975, the research team visited Sequoyah School and interviewer! 
the Acting Superintendent for the .summer , while ^the Superintendent was on 

educational leave. The Acting Superintendent indicated that he had 

«■ 

received no information regarding the Presidential/Secretarial Objective 
from the Area Office, and that such discussions among the school personnel, 
or in faculty meetings regarding these objectives, were merely the curio it 
of individual people* ^ He further indicated that he had been given no 

• ■ . , 77 
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instructions to engage in any other activity ^regarding the Presidential/ 
Secretarial Objective. 

At a later meeting (some three months plater) with the Superintendent , the 
research team learned that he, also, had been given no instructions to 
provide presentations to his faculty and staff members or to any otljer 
possible target populations. 

However, a letter dated February 7, 1975, was sent to the tribal chiefs of 

^he area tribes involved,, informing them of their options under the 

Presidential/Secretarial Objective, and requesting their cooperatioi^^ in 

implementing^ the Objective. The letter was signed by the Acting Area 

' M 

Director . 

Eufaula, Jones, and Carter Schools . ' 

The study -team made brief .visits to each of the three dormitory schools 
noted above, and . iritervie^Ved the following people; The counselor, Eufaula 
assistant. principal, Jones; and at Carter, several staff members. At 

these dormitory schools, there was no awareness of the Presidential/ 

/' 

Secretarial Objective, nor had there been any presentations to them or to 
the staf f^embers. 

In view of the above observations, it would appear that responsibilit/ for 

disseminating information regarding the Presidential/Secretarial Objective 

had not been assumed by the Muskogee Area personnel. The reason for the 

unassumed responsibility, it appears, is that Muskogee Area personnel have 

not felt that they should undertake such responsibility. This confusion 

ife felt to, be the major obstacle to successful information-dissemination 

in this Area. ' 

/6 
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Anadarko : On May 28, 1975, the research team visited the Anadarko Area 

Office, and conducted interviews with members of the Education staff, and 

It was learned that a number of meeting addressing the Presidential/^jecretat ial 

Objective had been held with tribal councils. Ten tribes had been contacted 

in the Anadarko Area, with meetings being held at Ft. Sill, Riverside, and 

Anadarto^^^/^ttend,ance at th^se meetings was minimal, possibly as a result 

of lack of compensation to attend. Presentations had also been made to 

advisory school boairds at vChilocco cind Haskell. In three o£ these meetings, 

no materials from the training packet were used, however, in two instance-^ 

♦ 

some of the manuals were utilized. The reaction on the part of the Area 
Director was that the training packet presented the material in "too 
simplistic" a fashion. In one case,* at Chilocco, the meeting was felt to 
have produced negative results in that the counpil members felt that the 
contract school concept was being pushed to the exclusion of other po 
options. In other instances, the imposed decision deadline (June 30, 
was objected to by tribal people, since it was felt that more tim^ would 
required to make such an important determination. 

On the afternoon of May 28'', the research team asked to attend a Kiowa 

V 

Housing meeting being held in the Area Office building. Of the eight 
Kiowas in attendance, only two had ever heard of the Presidential/Secretarial 
Objective, and felt that they had minimal information. The pther six in 
attendance had not heard of the school options available for Indian schools. 

0 

o 

Riverside School ^ * 

The research team made a site visit to the Pdverside School. At that, time, ^ 
the team interviewed the principal and the superintendent o£ ^the Riverside 
School, ^he Riverside principal indicated that the Presadential/Secretar i li 




Objective H^d been discussed in staff meetings, ^ and that staff members 

were well acquainted with the Objective. He indicated that ther.e was 

little grass roots information regarding management options available for 

« 

Indian schools. He indicated that he was under no. instruction to pursue 
ar.y further activities regarding the Presidential/Secretarial Objective 
wit,h the Riverside School Board, and with his teaching staff. He further 
n-iicated that he had attended two meetings where a presentation of the 
'w-aaement options available were made by Area Office personnel. These 

zxnqs were held at the Riversid^^School and Agency office, with 
approximately seven or more tribes in attendance. There did not appear 

be any further contact or activity, or reaction, to the presentations, 
after the initial meetings were held. ^ 

4 

Fort Sill School » ^ 

- - - " ^— * 

"^n nay 29, 19^§^Jthe research team interviewed the Acting Superintendent 
of the Fort Sill Indian School, There ^seemed to be minimal awareness of 
*-he Presidential/Secretarial Objective at Fort Sill,-, with no activities 
r-^rraiently having been tak'^n, and with no insturction to engage in any 
activities addressing the Objective-, 

Eastern : On July 7, 1975, the research team. visited the Cherokee Agency 
Office in Qherokee, North Carolina. Interviews were conducted with the 
Agency Superintendent, and with the chairman of the tribal council. They 
indicated that tffei^nterpretation of instructions from the Area Office 
was that, i!f thereU/as no interest on the part of tribes for contracting 
per se, then Tip resolution from tribal, councils was necessary. The 
research team interviewed several individual tribal 'covincil members who 

. GO. ' " ' ' • 



' .were meeting on that date. None had heard of the Presidential/Secretar lax 
Objective, .However, several were cognizant of the contracting only of 
specific activities, such as food services and busing. An interview on 
July 1, 1975, was held with the Assistant Area Director for Education in ^ ► 
the Eastern Area. He indicated that he had received letters from the 
chiefs of the Seminole, Choctaw, and Cherokee Tribes, indicating that 
these tribas did not v^ant to change the present management system, but 
wsuited to remain "as is." Although these decisions were apparently based 
upon tirbal action, there is colts iderable indication that no formal trita.! 
action was taken on these questions. The Miccosukee Tribe had already 



become a contract school at this time. The Chitimacha Tribe of Ijouisiana, 
when offered a presentation of the managrement objectives, declined the 
invitation,, It was learned that the Cherokee Tribal Council' members were 
not familiar with the Presidential/Secretarial Objective, nor had they 

- 1 * 

been presented with the training packet. 
Choctaw Central School 

The research tecim made a site visit on November 18, 1975, to the Choctaw 
Central School and met with the Assistant Principal. She indicated that 
no formal staff presentations regarding the Objective had been given, but 
that some of her staff members were, acquainted with the Presidential/ 
Secretarial Objective. On that same day, the research teaim met and inter^ 
viewed a Choctaw tribal employee, operating as a school planner. One of 
his functions was to tram the schoql board in school planning, and to 
acquaint them with possible management options available. Ke indicated 
that filmstrips .had been -presented in the surrounding communities and 
that they had been felt to be useful to thos receiving the presentation.:. . 

: -SI 

o ■ . . ~ 
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further indicated that a master planning program for the school boaru 
using filmstrips and slides was being shown monthly -at regular school board 
meetings. The Agency Superii>tendent and tribal officials were interviewed 

m 

and they reported considerable interest in contracting among the Choctaws, 

Evaluation of Training Packet 
The research team has reviewed the entire BIA-p^repared' training packet 
dealing vith the management ppti^ns for Indian education. In addition, 
^team members have interviewed dozens of persons who had utilized the packet 
m order to give a presentation to a target audience, or who had been gavor. 
a presentation utilizing the training paoket# The following generalization 
about the training packet, therefore, are a compilation of reactions on the 
part of the ^research team who studied the materials, and on the part of 

/ y 

several dozens of people who were interviewed or surveyed regarding*^ie 
training material". 



It was virtually unanimous that the information contained in the t'Wininq 
materials was accurate and could be relied upon. It was also practically 
unanimous that the materials were far too long to be presented efficienti/. 
Several N^ersOns commented that perhaps one person could be- trained with the 
entire packet, and then could refine and .abbreviate presentations by provid- 
ing synopses and surfimari^s of the rather voluminous materials in the packe^, 
Many comments were voiced rega'rdin^ the level of difficulty of the material 
themselves. The mos't often expressed comment was that the materials werfe . 

' . * \ 7 

iSuch too simplified, peflj^s even .insulting to the intellectual levels/of 
most Jndian peoples. <However, smaller numbers* of critics indicated that 
the materials were too complicated*, and should be simplified somewh/t, 



,.Cveraii, it -was felt by th^ Research ,te^ that the materials were maie S'^i o- 
what, roo^e simplified than perhaps aecessary. In" fairness' to the develoj^^ers 
of the *1:rai3iing .materials, it sho\ild. be not^d.'^that >the task imposed to 
develop such a trciinir\g packef was a most sumbitireus one; thajti is', to • 
coftuaiinicate gr;eat reams of technical and' ^ilosophic^l infdrma:tiori to. a 

iqredt variety of petoplesV some with extensive exposrue to such- technical 

'S^* , ' . *. ^ . ^ • . ^ , " \ 

m^t^rials *and some no exposure , whatsoever ; ^some /highly educated and 
-soptiisticated , and others- with , very little educ^tioh or cSophistifcatiqn'^ in 
such ;i4gal and ,te<yinical matters. It is dcmb.tful that the finest of all * 
training packets could be .effective in commiinicating well with' the diver- 
sitv of people involved in the taregt, populations. r-^ 

- fecoimhendat*lbDS . * . ^ ^ 

The study* team strpngly f*eels that the training packet not' only should ^be' 
,'use*d, but that' its use^'^shpuld-be foah^iatory ."in all '^eVs/ \F^iTtl\e'rm6re, it 

J is recommended that individual -persons should be designated 1^o become 

expert in' the content of the training packet, smd to interpret the training 
D^acket in' accordance with their .sensitivity to the nJids and levels^of 
ande^rstfindinq of the target audiences. ^This recommendation is one possible 

/way to av.oid the claiJfis of "insultingly simplistic," or "far too complex," 

. which, as noted ^ove, were often made in reaction to the presentation. 

* *■ ' * ^ ' 

Since the content was felt to be highly valid,, and since the packet contain 

• • • \ !^ ' * * ^ 

little ^r po irrelevant -content, little can be accomplished by attempting 

to condense 'the existing, training packet. Any- shortening or condensaticn . 

• ' *» '« 

^- ^ . , , - 

.would probably have to be accomplished, as mentioned above, \>y having a 

trained person a^Aterpret in a manner appropriate to the given target 

/ populat^idn . ^ ^ ^ ' . * - 



Evaluation* of the Operating Plans 
in the Area Offices " 

Aberdeen ftfea 



Of the fguT ^Vreas under study, in the present research effort, the Aberdeen 
Area is clearly the most Advanced with respect to the implementation pf^ 
^ the-Presider^tial/Secretarial Ob/ective. ' As noted in the descriptions of 
•activities accomplished in each of the respective schools studied,, there 
were ninherous presentaUons made to the target audiences in the Aberdeen 
Area, and considerably more awareness of^the management options available 
than in any oF the otftgr three Areas under consideration . It appears, 



f-forr examination of correspond^ces , «at the Area Office personnel, have 

inamtained excellent communication with the tribal councils, the school 
% • ♦ 

, boards, and with the education personnel of the schools themselves. It 
appears^ however, that there is little awareness of the management option:? 
and the Presi^ential/Secretarilil Objective on* the part of grass roots 

. members *5f th^ tribes involved. Howeyer, it should be noted, that such^a 
condition is 'not unique to Indian tribes,, but may be a condition of poll-' 
tical apat^xy on the part of many citizens in our society. 

J » * * . * 

Anadarko Area * * * * ' , ' 
\ — 

• As noted in the description of activities in the Anadarko Area, there was, 
some awareness of ^the Presidential/Secretarial Objective. Although there 
seemed to have been some" initial activities addressing the Objective, there 
does not seem to be much current activity (as of ^June, 1975) , or adequate 
reporting betwefen the tribes, the Area Office,^ arid t^e Central Office, ^^he 
Area Office seems to believe that sufficient information regarding the 
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Acuiagement-'^ptions has been conv4yed to the tribal chiefs, the tribal 
councils/ and to the tribal members themselves. However ^ our inquiry indi- 
cates that there is much more inf,orTsation needed by t:he target audiences. 

Eastern Area . , 

• * 

In the Eastern Area, there was mixed success w^^ respect to achieving 
awareness pf the Presidential/Secretarial ObjHLtive. Although there ha3 
been some Presentations of training packets by a Central Office Education 
Specialista with these presentations haviftg beSn well received, rhere 
appears to have been limited folxow- through* It appears that too nu^. , 
reliance was placed upon Central Office personnel, the developers of- the 
training packet, to the exclusion of additional efforts. .There were, h>.;:- 
ever, other apparent reasons for .limited dissemination activity. For 
example, the Miccosukee Tri'be had already contract^ed their schooling syste^. 
As a consequejice , presentations to the target audiences of the Kiccosuke^ 
Tribe were felt to be somewhat irrelevant. 

One of the more successful efforts in the Eastern Area was felt to be that 
of the Choctaw Tribe. The Choctaw Tribe had hired its own school planner, ^ 
who was actively involved in edutfjting target audiences with respect to 
management options available. While this effort was felt to he commendable/ 
It was- felt t]ia,t the Area Office may have relied too much on this particular 
effort, to the exclusion of other dissemination efforts- 

Muskogee Area 

The Muskogee Area appears to^ have achieved limited dissemination of infor- 
mation regarding the Presidential/Secretarial Objective. It was felt by 
the research team that the limitfed success in the Muskogee Area could well 



be' attributed to a^ changeover in personnel at a critical time 'in the assic;:,- 

*Tient of responsibility regajrding dissemination of informa€ion about the 

Presidential/Secretariat Objective. Specifically, there was a changeover 

of the Area Director and the AssisstaTJt Area Director for Education at 

approximately the time the dissemination task was levied upon the r-tuskog.ee 

"Area. In a&dition/ there appears to have been 'a, reluctance to utilise the 

^training packet ,| and to introduce the manaj^ent optiojns j^n the Muskogee 

Area. In interviews wi'th the Muskogee Area personnel, it was- felt .thau a 

::*nilo3cphical difference regariiing the dissemination task existed betwe^i.:. N 

-ne Central Office and the Muskogee Area. Muskogee Area personnel expressect' 

a reluctance to disseminate information regarding manag^ent optign^^, since v 

m their estimation, such dissemination might infringe upon independenV • 

decision-making of t;he Indian peoples in^^^lved. It appears that the Muskogee 

2irea personnel felt that they had an option as to whether or not ^to pursue 

mfonnation-dis semination activities addressing the Objective. *It perhaps 

should have been clarified whether or not it is the option of any Area to 

« 

« 

decide, on its own, to pursue, or not to pursue, information-providing 
activities with respect to the Presidential/Secretarial Objective,' 

Evaluation of Overall Strategy and Operat^Ln^ Plan 
/ of the 'Central. Off ice of Indian Education Programs 

As note(r previously, there- was tremendous variation in the four Areas 

studied, in terms of the success in disseminating information to target 

audiences regarding the Presidential/Secretarial Objective. In those Areas 

where success in disseminating the inforamtion was felt to be minimal, the 

research team made efforts to determine why such -was the case. Success of 

the operating plan of the Central' Office was clearly achieved in some of 

86 



ERIC ; 



3 

-19- 



the Areiis udncr study (see individual Area5 in the text) . irv those Are:i? 
of high success, praise must be given to the Central Office for the mann'e.r 
in which it levied the task 'upon these Areas # an<a followed through with an 
adequate reporting system. Further/ it i^ a tribute to those Area personnel 
*who, given a demanding taslc,.did indeed fulfill the information-di'sseminati^ 
Objective, quite adequately. Suggestions for improving reporting by the Area 
to- the Central Office, are made below. 

Reconanenda tions ^ ' ' 

First, th^ individual Areas must specify, the the Central Office exactly" wh: 
^t the Area level has been designated as the person responsible for imple* 

mentation of the dissemination 'of information required to achieve the 

'/ . " ' . 

Obiectivei Next, the Areas shc5uld clearly specify to the Central Office 
... mm 

which/ in their particular Area are the' priority target audiences to be 

addressed. Since different pariorities will be assigned, in accordance 

with the uniqueness of the particular Area, agreement between the Central 

Office and the Area regarding such prioritization -should be clearly 

specified. The success of the information-dissemination in some of the • 

Areas under study clearly indicates to the research team that the overall 

strategy' and operating plan of the Central Office is viable. If these 

above recommendations are implem^ted, then the reporting plan df J:he 

Central Office should function smoothly in all the respective TUreas. 

* < . ^ ^ ^ 

Survey Data 

A survey instnmient was developed by t'he research team and sent to the 
following target populations: Members of tribal governments, tribal member£. 
BIA school boa^d members, peirents of BIA school students, and staff members 
of BIA schools. (See questionnaire in appendix.) The questionnaire was 



developed in order to determine the extent; of information regarding the, 
Presidential/Secretarial Objective, on the part of the target audiences 
named 'above. In addition, it attempted to determine how such information 
was obtained, whether or not the information was felt to be sufficient, 
wheT:her the BIA training packet was utilized, and whether or not the 
?res:Ldential/Secretarial Objective was felt to be a precursor to termination. 



^:ite the fact that 685 questionnaires were sent out to the various 
-arqet audiences, a total of 94 (14%) were returned. The greatest number 
-f. r'^turns for a given target audience was 59 questionnaires (from tribal 
r^r^ers of several different tribes) . For -this reason, there can be no 
assurances tltat data from the returned questionnaires are necessarily 
representative of the positions or views of any given target audience. 
Consequently, information provided via the questionnaires must be con- 
sidered tentative, and only suggestive of what may be the true feelings 
and //lews of •,the respective target populations . * 

;:'uestionnaire data are reported below : 

Survey Data Summary 
tX'er heard of Presidential/Secretarial Objective? 

No. % 

YES \ 34 .36 ^ 

NO^ 60 64 ' 

If "YSS"*, becatfne aware * thro ugh: 

f 

^Ariea Office Personnel 23 56 

Tribal Council • 49 

BIA Publication 6 14 
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No. % 

Local News Media 3 7 ■ • 

Indian Communfty Members 2 5 

School P\iblication 1 2 

Trib^il Publication 3 7 

Can you decide which system you prefer? 

.YES 23 64 

NO . ' 36 • . 

Were you given a BIA-prepared presentation of tapes, slides, etc.? 

YES \ 14 45 

NO - . 17 * 55 r • 

\ xf "YES", was irtaterial explained adequately? 

YES ' 15 60 - ' 

NO ' 10 40 

Do you agree with the Presidential/Secretarial Objective? , * 

' YES ^ ' ^ 13 : 57 

NO , ' ;10 43 ' 

Do you think it will lead to termination? 

YES . 19' 59 , 

•NO 13 , 41 

V - . 

Discussion of Survey Data 
• « 

Data from the returned survey instruments indicate that, of the 94 returned 
questionnaires', 36% of the respondents had heard of the Presidential/ 
Secretarial Objective, with 64% indicating that they had not. Of those 
respondents who indicated that they had heard of the Presidential/Secretarial 
Objective, they indicated £hat they had been made aware by the following 



aourceat Area Office personnel, 55%; tribal council, 9%rBIA publicat.lQr.. 
14%; local ne.ws media, 7%; Indian community /embers, 5%; school 'publication, 
■ 2%; and tribal publication, 7%; it is eviden£N^ the major source of 
information regarding the Presidential/Secretarial ObjeJrtl^was Area Office 
* personnel . As noted in the survey data summary table, of tbe eight possiole 
sources of information regarding the Objective, Area Of f ice -.personnel were 
Cited as the source 55% of the tLme. 

W-hen the ■ respondents were asked If they were -in a position to decide whiqh 
n>.ar.ageroent option system they preferred, 64% felt that th6y were, 'with .364 
indicating that^ they were nbt able to decide their preference. . ■ ' 

Of those respondents who indicated an awareness of thg-Qbjective , 45% 
^.y^indicated that they had been given BIA-prepared presentations, with 55% 
indicating that they had i^ot been g^ven a presentation. Of these respondents 
who had been given the BIA training 'packet, 60% indicated that the material 
, adequately explained the management options, with 40% indicating that it 
did. npt . 

Of those respondents who indicated awareness of the Presidential/Secretarial 

Objective, 57% indicated that they were in agreement with the Objective, 

with 43% indicating that they were not in. agreement. , Wljen respondents were " 

Tasked whether implementation qf the -Presidenti'al/Secretarial Objective 

would J,ead to .termination, 59% expressed ^\feeling that it- would lead, to 

termination* With 41% feeling that it wsuld not 
' . 

Analyses of the "survey data generally agree quite closely'-vith the observa- ' 

tions made by the research team in the scores of interviews tHey had 

conducted in the "four Areas under consideration. It was clear to the 

O ' -23- 



ERIC 



90 



'research team that, when People were aware of the Presidential/Secrctari^J 
Objective, it was the Area Office personnel who were the source of informaLxwH, 
as opposed to. tribal councils or oth.er potential sources. Further, of those 
.who had be^n. given ^ the BIA-prepared training packet, approximately two oat 
of three pex^bris felt that the material contained in the packet fexplain^d 
' the *Trt^agement onions adequately. _ • 

^t should be noted that 64% of the resoondents indicated that they had 
sufficient information upon which to make a preference of one of the 
management options available. It appears that, if a formal presentati / . 
is made to members of the target populations, that they do, in fact, obtai\ 
sufficient information regarding management options. 

. When respondents were asked whether or not they were in agreiement with the 
Presidential/Secretarial objective, only a slight majority (57%) was in 
agreement. When asked whether the implementation of trie Presidential/ 
SecretcL2n.al Objective would lead to tenniantion, almost 60% indicated that 
it would > ^ * . . " 

Below is a -compilation of comments made by questionnaire respondents: 

South Dakota - A member. of the tribal government stated, "We understand the ^ 
Flandreau School is not designated as an area of consideration and we^ do not 
know why . " 

Suggestions on how BIA can 'help get sufficient information about ^school 
management options: 

1. South Dakota - Thinks people on school boards need to be educated so tj^^^L 
the contracted schools don't fall by the way as many have in their artri. 
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2. South Dakota - Training aessions should be conducted on a local basib. 

3. South Dakota - Printed information explaining each option would be very 
helpful* 

4. .South Dakota - tieed more workshops on school board development, ev^tuall/ 
would like to see BIA schools function under Indian people. 

5. South Dakota - ^kDre cooperation. - 

^* South Dakota - The Bureau is forever imposing deadlines. We had very 
little time to digest the information , and no time to take it out to 
the patrents* 

. Muskogee - Send someone to the school to meet with the staff and explain 

.the options, ^ 
^. **«uskogee - Small seminars* Workshops staffed with learned' unbiased 
consultants • 

3. -Muskogee - Would prefer schools remain as they now are. 

Ideas why BIA materials did jiot explain objective adequately: 
I. Muskogee - It was only discussed lightly at a pre-school workshop. 
J. South Dcikota - The slides were too simplified, they were an insult to 
the integrity of the t>irbal .members. 

* 4 

i. South Dakota - The method of disbursing the informatioji could have been 
presented in a more interesting format. 

4. South Dakota - It was very misleading as to the success of the programs 
that have been initiated. * 

5. Oklahoma - Too complicated to understand, should be in layman's language. 

Mu^skogee - A tribal member noted, "I believe an individual is entitled to 

make decisions which involve the future ©f his welfare." 

I 
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South Dakota - *A tribal member jioted , "I believe that Indian Education i': 
congressional oblig>ation under law and if ever to be dissolved, it should 
people's! input and consent as the party to the Peace Treaty." 



South Dakota - A tribal member stated, "I was on the tribal government fr 
1970 to 1374 'and was Tribal Chairman in 1974. But was asked to resign 
because there may be a conflict of interest, being that I was a*BIA emplc: 
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, > V. A recen.t ))oliv:>, stateipent of the Uni.teid St^ted^gOAiernme^^^ ^eriVRts^o.^fib^ ^ ^ 

, ^ tKO^h tp/make devbionsjfor thems^iv,<?s in the'are^ Indiajt <?d|^\cSi|^v called the . . * 



; / ^t^ ill >!t|mpt >^ bfpce^^'have* 1^^ m^feiijg ,present§tip,iis to tribargxpupsJ and,. 

-iSJ^t^,^ tribf5r1Trio^^^^ CQ.mmunitl^^^ in ^'^tteinp^ to explain tjie choices ox^ ' 1' 

. TT^ar^gern'fnf systems availabfe'forlr^^^^^ ,Qur. company has been conijuctipg a>,study'fo^ 

-ietexniine bo^ successCuJly tji^ ulforn^tjod^^^^^ Presidentiai/Secretari^ 
' " * .fceen .presented t(^. Indian^ ^eojjles. '~ - . '.^ \ ^.-^ -^^v^^-"- " ' ^-""-'^ 'V^' 

W ' jid vpu^plelse assist;^tis by taking a few m^bufes Qf y<?uF -l^n^IaBd,.answ^ the folIowigyg^qMestionr ^ , 
' ^liaire, -Your assistant^ will be" of ^eatMi^lp (o-Uidfaft people., tjiartl yau, v. a. .1 / ^ ? 

y^^'^^i J,%V- '^^lilembBroC a'^Jrib^'governmeat \ v- -:V ^ _ . '^'J v 



v^^emf3^^^f a BJA school; bdardv 
Parjent of .a BIA student; 



'-^;y :"V Student ina BIA ^chopi;.^^ ' \^ -/^ - ^ ' . "''v, 

v> . :> V / y. ^ v--i:^.^ , ; - - ^" - ,v 

, . ^ \ Staff %bber a W \x ^ " \ ; ' ' v ; ^ '/ ,J 

' . ^Have you even heard of^tfre'^idential/Secreta was described ^bQ«e? . ' 

; P'^^^ retu^-:the questionpair^,to us in the enclosed .envelope. • Thank you. > 

^"^ ^ '^r^"- ^ ' ^ V ■'V,.,v' ^ . : ' , 
* V ' ' ' - y^^. please checK'^Jiow you 'b^pame aware of \he -objective; 1 : , / ; . 



.'V'v ..Presentatipn by tribal cpyn^^^^ . • t ^ ^ , ^ 



O 7 %ApabUcatic^ J\ -Q;4^ r^. v. . ^ 



Local Media (papL^r* radio, T%!X^ - 

V 

Members o( the hiUiiyi comiuumty 
School pub^icution 



' Tribal publication . * ^• 

. v\" r However you got inrormalion about the several >choo! management options available, do you 
, . feef.that you know cnouch to decide which management system \ou like best? 



If no, plcjse suggest how BIA could liclp yon aei sul'tlcicnt information about school manage- 
ment options. , • " 



• <. ' ' — , 

If you marked abo\e that you became acquainted N\ith the Object i%e through a presentation by 
. Area Office personnel or through tribal council members, were you gi%e a BIA-prepared presentation 
— consisting of slides, cassette tapes, and printed materials dealing with "the Objective? 



Imp 



"v^ No • 

4 , If Yes. please answer the following;^ ^ * , 

you feel that the ^lA-prepaFvd materials explained the Presidential Secretarial , 
Objective adequately?^ * ^ * * 



Yes I . No. 



If No. please e>Cplain jvhy. \ ' 



If Yes, are you in agreenienl with the aims of the I^residcntial/Secrvtanal Objective? 

Do ypu'^recl thal^ihe i'residential/Scvjetarial Objecli>e wi|l somehow lead to termiiuiliun? 

> ' ■ '..i^:^x ' ' ■ No.: - • . 

^ • Thank "V^u for ybur Jicl|\.Y ' 
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